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PREFACE 



This Report is the third element of the Rand /HEW study of performance con- 
tracting in education. The first was a Report by J. P. Stucker and G. R. Hall, The 
Performance Contracting Concept in Education. The Rand Corporation, R-699/1- 
HEW, May 1971, which discusses the theory behind performance contracting and 
how it was applied during the 1970-71 school year. The second element comprises 
six volumes, which examine eight performance contracting programs in 15 schools: 

1. R-900/1-HEW, Conclusions and Implications, by P. Carpenter 
and G. R. Hall 

2. R-900/2-HEW, Norfolk. Virginia, by P. Carpenter 

3. R-900/3-HEW, Texarkana. Arkansas and Liberty-Eylau. Texas. 
by P. Carpenter, A. W. Chalfant, and G. R. Hall 

4. R-900/4-HEW, Gary, Indiana, by G. R. Hall and M. L. Rapp 

5. R-S00/5-HEW, Gilroy, California, by M. L. Rapp 

6. R-900/6-HEW, Grand Rapids, Michigan, by G. C. Sumner 

The present Report, distilled from Rand’s findings in both previously reported 
and new research, is a Guide addressed to school board members, administrators, 
and other decisionmakers involved in school district affairs who may oe contemplat- 
ing a performance contracting program. It delineates questions, issues, and choices 
they are likely to confront. 

The Guide is published in two parts. The parent volume, R-955/1-HEW, dis- 
cusses the planning, operation, and evaluation of performance contracting. The 
present volume is a Technical Appendix that goes into more detail on problems of 
test and measurement and of cost analysis associated with performance contracting 
programs. It also reproduces the contracts involved ir. eight programs. 



SUMMARY 



This Technical Appendix to R-95f i-HEW contains a more detailed considera- 
tion of the problems of measuring student achievement, and of program and re- 
source analysis. 

Appendix A, dealing with the measurement of learning gains, develops six basic 
points: 

• There are obvious limitations to group data. If nationally noimed standard- 
ized tests are to be the means of measurement, analysis of varrous types of subgroups 
within a total heterogeneous school population might assist in minimizing these 
limitations. 

• The duration of performance contracts should be critically examined. The 
shorter the program, the less the probability that any achievement acquired can be 
observed. 

• A time series of measures would be more desirable than either pre- and post- 
or post-only measures. 

• Criterion-referenced items, if used, (1) should have specified quality criteria. 
(2) should be used with a comparison population to obtain some evidence of their 
appropriateness and difficulty, and (3) should in every instance be constructed in 
pools of items dealing with the same performance objective, so that random selection 
of a criterion-referenced item for assessment r light be drawn from the pool. 

• A variety of assessments (including student products, teachers’ evaluations of 
understanding and learning, etc.) should be combined with both nationally normed 
and criterion-referenced assessments of student achievement. 

• If a population serves as its own control, the selected performance objectives 
and the assessments of those objectives should be pilot tested on a matching compari- 
son population. 

Appendix B explores the conceptual and methodological basis of cost analysis, 
and describes a planning cost model to be used in estimating what are here called 
comparable replication cost and incremental cost. The same basic procedure is used 
in estimating both. Comparable replication costs are essentially derived by using 
standardized resource costs for all programs and districts. The results are useiul for 
comparing various possible programs and thus identifying the most promising confi- 
gurations for a particular school district, but ^hey do not reveal what a particular 

> v 

A 



program would actually cost in that district. For the latter purpose, it is necessary 
to conduct an incremental cost analysis, which takes into consideration the re- 
sources available within the district and the local prices that apply. Appendix B 
contains a highly detailed example of such an analysis, loosely patterned after a 
1970-71 performance contracting program in Grand Rapids, Michigan 

Appendix C contains eight illustrative contracts between local educational 
agencies (LEAs> and learning system contractors (LSCs). They are reprinted from 
the six volumes of Case Studies in Educational Performance Contracting . The Rand 
Corporation. R-900-HEW, December 19/1 (see Preface). 
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Appendix A 

PROBLEMS OF MEASURING STUDENT GAIN 1 



Performance contracting has greatly increased the attention paid to the prob- 
lem of using test results as a measure of change in student learning. There is 
overwhelming consensus in the professional literature that the measurement of 
individual pupil-gain scores from standardized achievement tests by simply sub- 
tracting the pre-test from the post-test score is inappropriate and inaccurate, rit 
ings by Lord, Stake, Stake and Wardrop, Cronbach and Furby, and Snow emphasize 
the inappropriateness of such analysis of group test data for individual pupils.- 
The paper by Stake and Wardrop provides a particularly useful illustration of 
the unreliable and fallacious interpretations that might be made by merely sub- 
tracting a pre-test grade placement from a post-test grade placement for individual 
pupils receiving special instruction in a performance contract. This illustration 
demonstrates the effects of: (1) the reliability of each of two parallel forms, (2) the 
intercorrelation of scores on two forms, (3) the standard deviation of the test form, 
(4) the reliability of the difference scores, and (5) the standard error of the obtained 
differences. Recognition of these characteristics of group measures prompted Lord 
in 1956 to develop a procedure for computing the "true score" as a substitute for 
obtained scores in either pre- and post-tests or time series studies of student growth. 
Cronbach and Furby propose a procedure to estimate a true score, and they sugges 
that an individual’s status is best described by a series of estimated true scores 
rather than the difference between two status scores. # 

The possibility of obtaining a reliable indication of the change of individual 
students’ achievement is decreased in those performance contracts that provide 

■ This appendix was prepared by Dr. J. Richard Harsh, Southern California Regional Office, Educa- 
tional Testing Service. 

2 F. M. Lord, "Elementary Models for Measuring Change,” in Chester W. Harris led.). Problems in 
Measuring Change. University of Wisconsin Press, Madison, Wisconsin 1967. Robert E^StakeTesung 
Hazards in Performance Contracting,” Phi Delta Kappan. Vol 52, No. 10 June 19/1, PP, f - Stake 

and Wardrop, "Gain Score Errors in Performance Contracting,’ paper available from authore University 
of Illinois at Urbana-Champaign. L. J. Cronbach and L. Furby, "How We Should Measure Change -Or 
Should We?,” Psychological Bulletin. Vol. 74, No. 1, 1970, pp. 68-80. R. Snow. Gain Scores in Perform 
ance Contracting,” unpublished paper, Stanford University, Palo Alto, California. 



instruction over a relatively short time (three to eight months). As shown by Stake s, 
Snow’s, or Cronbach’s illustrations, the statistical characteristics of group measure- 
ment indicate the probable and expected variability of a status score from a true 
score, as frequently (in grade placement terms) representing from 1/2 to 1-1/2 vears 
of grade placement units. Even conservative interpretations suggest that one-fourth 
to one-third of the individual students might show test performance on the post-test 
which would be in excess of the elapsed period of time on the grade placement scale 
merely as an artifact of the expected variability of performance on that scale.rather 
than because of any change in pupil attainment. Some of the professional papers 
have illustrated that as much as two-thirds to three-fourths of the population will 
obtain post-test scores that (when considered in relation to the standard error of the 
two measures, the intercorrelation of the measures, and the reliability of the differ- 
ences of the scores) show no indication of a change in performance even though the 
later score may appear larger than the earlier score. 

When the performance contract is concerned with these relatively short time 
periods, the unreliability of the difference in performance from the beginning to the 
end of such an instructional period is maximized, certainly on these group measures 
that are primarily designed to afford an opportunity of observing differences among 
individuals in groups, but not of providing reliable indices of individuals change 
from the beginning to the end of a six- or eight-month period. Some measurement 
specialists have suggested that this problem can be partially reduced by substan- 
tially increasing the time interval and thus affording more probability that the 
chang es reflected by the measure are of sufficient size to generally be larger than 
the expected error variance or standard error of the difference. Even doubling the 
time period from six months to one year or eighteen months, there would still be 
a probability that some students would appear to have made growth, while the 
change might reflect the variance in successive test performances. Some students 
may show regression, which also may be attributed to measurement variability. 
Complete confidence on discrete and valid changes in attainment may not be at- 
tributed to all individuals in the total group. As the instructional period is increased, 
it is probable that the difference between beginning and ending indications of in- 
dividual pupil status could be viewed with more confidence and have more reliabil- 
ity. This is also related to the question: when is a difference a real and observable 
difference, in contrast to a difference, while statistically computed, which is not an 
observable or real difference? 

Increasing the duration of a contract or the period of instruction from which 
pupil achievement is anticipated also suggests the recommendation that a measure- 
ment design in time series will probably offer more reliable results and provide 
greater confidence about the characteristics and status of the pupils from the begin- 
ning to the end. In effect, this is arguing that although each measure of individual 
status contains a standard error of measurement, as a series of these measures are 
obtained on individuals within a group, the combination of the measurements in a 
time series design generates a slope of scores from which a more accurate characteri- 
zation of the student’s "true performance” might be derived. Insofar as such a time 
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series might be spread over two or three years, the probability of having more 
reliable or accurate indications of the pupils’ attainment status is greatly increased. 

To avoid some of these described difficulties of individual gain scores, some have 
suggested the use of group data as a basis of payment for performance contracts. 
Critics of the use of group data point out that a contractor would be paid for some 
individuals in the group for whom no progress or even regression might have oc- 
curred, since the contractor would be paid for the attainment of the central tendency 
of the group, which conceals the variability of achievement that might have accrued 
from instruction or might have accrued whether a particular instruction was pre- 
sent or not. Recognizing the aforementioned criticisms, it is also worthy to note that 
the standardized measures lend themselves better to group than to individual meas- 
urement, and certainly the standard errors of measurement and standard errors of 
differences of measurement are substantially reduced when group data are being 
treated. Some of the criticisms of group data seem to assume that only mean or 
median performance will be considered. 

It might be appropriate to think of the subgroups that compose a total hetero- 
geneous student population, and then analyze the data of the various subgroups. 
This would allow the opportunity to reduce the standard error of measurement 
attributed to the individual by using subgroup data and also to see the effects of the 
instructional program on student groups of various subgroup characteristics (low, 
average, and high) during a period of instruction. In this regard, it might also be 
possible to have baseline data on previous groups of like age or assignment and to 
make contrasts between the treated and the preceding populations. This is a further 
elaboration of Snow’s suggestion that, to obviate the problems of computing gain 
scores, it might be possible to have performance contracts based on terminal objec- 
tives, and the payment would be in relation to the number or percentage of students 
that reach certain terminal objectives at the end of an instructional period. As 
suggested, to counteract the criticisms of the payment for those students who had 
already attained such terminal status, but not from the benefits of the instructional 
intervention, baseline data of preceding or parallel groups might be used as a basis 
on which such payments were weighted or assigned. 

Another substantial issue in the use of nationally normed, standardized tests 
for performance contracts is the relevance of their contents to the particular instruc- 
tional program and the performance objectives of learning. Criterion-referenced 
tests have been recommended as the most desirable solution to this problem. Len- 
non 3 and other knowledgeable test publishers have cautioned the overenthusiastic 
regarding items in terms of time, cost, and a valid theoretical framework for their 
construction. Early experience has also indicated that criterion-referenced measure- 
ment has received substantial attack, mainly in the vein of the credibility of the 
instruction being broader than or of greater significance than the specific and unique 
content of the criterion-referenced item. '"Teaching to the test” has recurrently been 
voiced as an issue of the credibility and validity of the learning accomplished 

R. T. Lennon, Accountability and Performance Contracting,” paper presented to American Educa- 
tional Research Association, New York, February 5, 1971. 




through the performance contract. As a potential solution to the problem of the 
criterion-referenced items’ quality, the item analysis statistics of many publishers 
norm-referenced tests offer some opportunity to observe the impact of an instruc- 
tional program. If, for example, a nationally normed test provides item data which 
shows the percentage of pupils in a heterogeneous population who mastered the item 
at age 9, at 10, and at 11 (or at various specified grades), then such item statistics 
might be used as baseline data for anticipated terminal performance; and the assess- 
ment of the treated population could be evaluated in terms of percentage of students 
attaining success on specified items that have excellent congruity to the perform- 
ance objectives of the instructional program. 

If unique and newly developed criterion-referenced items are used as the basis 
of assessing accomplishment of the contract’s objectives, then there is an imperative 
need for determining whether the difficulty of mastery of the content of such items 
is below, at, or substantially above the entry characteristics of the instructed popula- 
tion. For example, in one performance contract in which criterion-referenced items 
were used, it was discovered that 75 percent of a comparison population who were 
to receive no instruction through the performance contract were successful on all 
the criterion items prior to the year of the performance contract. In this instance, 
it would be obvious that at entry even the treated population would be substantially 
successful, and that the contractor was being paid for attainments chat had already 
been achieved by a substantial percentage of the student population. 

One of the issues in criterion-referenced test items of significance to learning 
and to education is that of the acceptance of short-term recall as a demonstration 
of mastery, versus the use of acquired information or skill in a variety of applications 
and contexts. Research during the Eight-Year Study in the 30 ? s and the early re- 
search by Tyler clearly demonstrated the remarkable disparity between short-term 
memorization of facts, measures of the recall of these facts, and assessments which 
demanded evidence of understanding of the content or the application and use of the 
skill or knowledge in a variety of situations. Current educational research also has 
some illustrations of this, which are exemplified by the very positive results from 
the beginning to the end of one year of Head Start and preschool programs. These 
results suggest the significantly higher achievement attained by children engaged 
in a special intensive program versus those not receiving such a program. However, 
some of the follow-up studies of Head Start children reveal that after one or two 
years the treated group were not significantly different from those who received no 
such instruction prior to their entry into the regular primary school program. 
Similar results are available from Title I projects, in which pre- to post-measure- 
ment during one year shows these populations to have significantly higher achieve- 
ment in specific performance outcomes than the comparison population in the same 
district. At the beginning or the end of the following year, the differences observed 
in the preceding year are unobservable in subsequent measures; moreover, other 
assessments and evaluations such as teachers’ observations of the students’ ability 
to cope with the next instructional activity also reinforce the notion that some of 
the measures were apparently reflecting the recall or retention of explicit content 
or material over a relatively short period. The treated students apparently had 



neither acquired nor assimilated the knowledge and skills they could use in a variety 
of applications in subsequent learning activities. 

From the available literature, it appears that the measurement specialists and 
designers of research and evaluation are in substantial agreement on the many 
problems of payment for performance contracts involving the existing nationally 
normed standardized tests; and they are also in agreement that, while criterion- 
referenced test items may represent far greater congruence to the performance 
objectives of instruction, there are still too many undeveloped requirements of these 
measures to afford confidence in their use of interpretation. These observations 
suggest that at this point in time performance contracts would be well advised to 
include the following considerations: 

• While there are obvious limitations to group data, if nationally normed stand- 
ardized tests are to be the means of measurement, various types of subgroups within 
a total heterogeneous school population might be the units of assembly of test 
information from which observations of the attained level of achievement of a 
treated pupil population would be derived. 

• The duration of performance contracts should be critically examined in rela- 
tion to the probability that any achievement acquired can be observable and usable 
achievement, in contrast to small and superficial acquisitions that have neither been 
assimilated by the student nor understood and applied in a variety of contexts which 
might represent substantial and significant differences in achievement or learning 
from the beginning to the end of instruction. 

• A time series of measures would be recommended as more desirable than 
either pre- and post- or post-only measures to describe the status of a student 
population. 

• Criterion-referenced items, if used, (1) should have specified quality criteria, 
(2) should be used with a comparison population to obtain some evidence of their 
appropriateness and difficulty, and (3) should in every instance be constructed in 
pools of items dealing with the same performance objectives, so that random selec- 
tion of a criterion-referenced item for assessment might be drawn from the pool. 
This would greatly obviate the present criticism of teaching to the specific, unique, 
and limited content of a single criterion-referenced item. 

• A variety of assessments (including student products, teachers’ evaluations of 
understanding and learning, etc.) should be combined with both nationally normed 
and criterion-referenced assessments of student achievement. 

• If a population serves as its own control, the selected performance objectives 
and the assessments of those objectives should be pilot tested on a matching compari- 
son population. This would allow some preliminary observations concerning 
whether acquisition of the performance objectives might be attained through matu- 
ration, extracurricular experience, etc., irrespective of the contracted instructional 
program. 
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Appendix B 

PROGRAM COST ANALYSIS IN EDUCATIONAL 

PLANNING 



INTRODUCTION 

Any examination of alternative educational programs must be concerned with 
their effectiveness and cost. Because student achievement is the salient measure of 
program effectiveness with performance contracts, a great deal of attention is being 
given to the problems of setting criteria of achievement and measuring educational 
outcome. Less attention has been paid to the equally demanding task of estimating 
and analyzing the cost of educational programs. If the instructional strategy of new 
programs is to be successfully utilized by educational planners, information about 
both cost and effectiveness must be available to the decisionmaker . 4 

This apoendix explores the conceptual and methodological basis of cost analy- 
sis, and develops a planning cost model for estimating program cost for use in 
evaluating alternative programs and in preimplementation planning for future 
programs. The model and its supporting methodology provide a consistent basis for 
estimating the dollar cost of educational programs. The development of the model 
was undertaken because the current costing state of the art does not provide a 
comparable basis for evaluating alternatives. The usual practice is to give the cost 
per student for a program with no indication of what the cost includes. 

When the cost per achievement year is used, the problems of measuring both 
the cost and the effectiveness are severe. Education Turnkey Sews has drawn atten- 
tion to several aspects of using this ratio for analyzing performance contracts. 

Even when accurate costs are obtained, it is difficult to compare them with 
school costs to see which is less, since school costs are kept and reported 
differently. The comparisons may reveal nothing more than different 
figures, especially since the firms may depreciate certain items much more 
rapidly than schools. ... It is even more difficult to try to contrast effective- 

- On this genera] subject see Charles Blaschke, "Performance Contracting Costs, Management Re- 
form and John Q. Citizen,” Phi Delta Kappan. Vol. 53, No. 4, December 1971, pp. 245-247. 
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ness with cost. If effect iveness is reported in tenths of'a year’s achievement, 
which some statisticians feel is cutting it too closely, and that figure is 
divided into cost data which is part hidden and part hypothetical, what does 
the public get? Will a school board really base a major decision on curricular 
changes on such a "cost per unit of achievement figure : J 

The ratios of cost per student and of cost per achievement year are widely used, 
probably because of the false confidence the "number" engenders and the relative 
ease with which it can be generated. In most instances, one of these ratios mas- 
querades as the sole output of cost-effectiveness analysis, although instances are 
rare in which it can appropriately be so. Wisely used, such analysis produces se\eral 
outputs: the aspects of cost, the measures of effectiveness, and the relationships 
between the two. 0 

In estimating the program cost to be used in comparing programs, the resources 
available within a specific district or assets inherited from discontinued programs 
are not taken into account, and a standard price for common resources, such as 
teachers, is used. The resulting estimate is identified as the comparable replication 
cost. It is, in essence, a comparable cost that normalizes the cost of programs. 

In estimating the program cost to be used in deciding whether a particular 
program can be implemented in a specific district, however, the analyst must deter- 
mine the resources available within the district and their local prices. The resulting 
estimate is the incremental cost to the district. This concept and methods for estimat- 
ing incremental cost will be discussed later in this appendix. 

Figure 1 depicts the role of the planning cost model in estimating both the 
comparable replication cost and the incremental cost. In this process, the first step 
in estimating either cost is to define the program s objectives, students, and resource 
requirements. These resource requirements are translated into the type of program 
cost estimate relevant to the decision to be made. The planning cost model helps 
insure cost comparability among programs for decisionmaking. 

A short discussion of the concepts and techniques of cost analysis underiving 
the model and techniques to be discussed may provide helpful background; there- 
fore, we present here some of the major elements of the theory behind the analysis 
to follow. 



COST ANALYSIS 

The purpose of cost analysis is to determine physical resource requirements, 
calculate the program dollar cost, and systematically evaluate how changes in the 
program will alter the resources needed and their cost. The approach is to determine 

1 Reed Martin and Peter Briggs, Education Turnkey News. February-March 1971. 
c For a discussion of problems and appropriate uses, see M. B. Carpenter and S. A. Haggart "Cost- 
Effectiveness Analysis for Educational Planning,” Educational Technology. October 1970. pp- -6-30. 
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Process of estimating the comparable replication cost and the incremental cost of programs 



the facilities, stall', equipment, materials, and services needed under a performance 
contract and to translate these resource requirements into estimated program dollar 
costs. 



Definition of the Educational Program 

The core of an educational program is an instructional strategy, which embo- 
dies both the resources and the way they are used. 

The first steD is to define the program: its objectives, students, the quality and 
quantitv of the required resources, and the types and magnitude of support activities 
or services. 



Determination of Resource Requirements 

Figure 2 lists the categories of data needed for determining resource require- 
ments -Table 7 below is an example of an itemized list*. Some of the categories 
pertain to resources directly. Others are functional packages, such as training, 
which are combinations of resource items. 

The data on students will also, of course, be used later in evaluating the pro- 
gram. Anv socioeconomic data on the district that affect the outcome should also be 
provided, such as income level, turnover rate, or mobility. The instructional time 
should be given, along with other information that relates to determining the actual 
time spent with subgroups of students or individual students. The student-teacher 
ratio is usual lv used as a proxy for this, but an effort should be made to refine this 
piece of information. 

In describing the facilities needed, the space requirments, including mobile or 
portable classrooms, laboratories, and their utilization rates, should be carefull> 
determined- Requirements for nonschool facilities should also be stated. The special 
needs for electrical outlets, air conditioning, carpeting, and lighting should be iden- 
tified. Furniture needs are to be specified, identifying any special per-student re- 
quirements. 

The needed quantities and qualifications of the program staff should be spe- 
cified. including certificated or certified teachers, special teachers, paraprofession- 
als, and other personnel. If a staff member is to work less than full time, the 
percentage of time he is to work should be giver*. Staff requirements iOr time be\ ond 
the "normal" school day should be stated. This includes, for example, custodial or 
security services needed to keep the school open after the regular da\. 

Equipment and materials should be identified as program-related, classroom- 
related. or student-related. Program-related equipment or material is needed be- 
cause of the particular traits of a specific program. Classroom-related equipment or 
material is that which is needed to equip a classroom for use several periods during 
the day. Student-related equipment or material is that which varies as a function 
of the number of students in the program. In developing a multiyear cost estimate. 
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Number of scudents 
Class tine 
Class size 
Number of sections 



FacriZztz.ee 

Space 

S tudents/classroon/day 

Utilization 

Furnishings 



Certified teachers 
Special teachers 
Paraprof essionals 
Other personnel 

Equipment 

Program-related 
S tudent-related 

y.at*cz~iaZc 

Program-related 

Student-related 

Ptc -a c rzri ae zraining 

iK-ccrvxce trcrirrlng 

O'uFicr s'u'p'pOTt- 

Incentives 



Fig. 2 — Format for program and resource information 



information about the consumable nature of the materials and about the lifetime 
of the equipment is needed to plan for replacement. 

The time allotted to pre-service and in-service training should be specified, 
along with the materials or equipment required. It should be noted whether training 
is to be given during or outside of the staffs regular working hours. If in-service 
training occupies a substantial part of the individual teacher’s time, additional 
teachers ‘or substitutes) may be required for the instructional load of the program. 

The requirement for program- related services such as evaluation or other man- 
agement activities should be given. It is preferable if the actual time or the numbers 
of consultants can be specified. In either case, the purpose is to provide some esti- 
mate of the magnitude and cost of these services, so the district can decide whether 
to buy the services or attempt to develop an in-house capability. 



Support from other activities refers to such service functions as transportation. 
For example, a particular educational program might need bus transportation for 
field trips. 

The resource requirements identified in Fig. 2 are meant to be suggestive only. 
If other data are available, they should be listed, since the purpose is to define as 
completely as possible those resources and cos^-genera^i ng act i \ i .a os needed to carry 
out the program. 

The resource requirements are then translated into the dollar estimates of 
program cost — either the comparable replication cost or the incremental cost — and 
are then used as inputs to the planning cost model. 



THE PLANNING COST MODEL 

The planning cost model is a mechanism for determining, conveniently and 
consistently, the costs of alternative programs. By design, the model is appropriate 
for pencil-and-paper operation as well as computer operation/ 

The model brings together the resources required (facilities, staff, equipment, 
materials) and relates them to program output in the form of activities. It thereby 
provides more information for making decisions about the merit of selected changes 
in the activity structure of the total program. For example, trade-offs between fewer 
but longer instructional periods and more but shorter periods could be assessed. One 
can also use the model to examine the cost consequences, for the total program, of 
changing resource utilization rates (e.g., student-teacher ratio) or resource costs 
(e.g., teacher salary). 

A basic task in constructing this educational model was to define cost categories 
affected by the performance contract. Those costs of school district operation not 
affected by the existence of the program are not included in the estimated cost of 
the program. An example will clarify this distinction. 

Because the cost to the district of' transporting students to and from school will 
continue whether they are in the special program or not, this cost is not attributed 
to the special program. If the program calls for field trips or other activities, how- 
ever. the extra transportation costs are charged to it. 

Cost Categories 

The items, services, people, and activities and their costs can be brought 
together in one format: the cost element structure shown in Fig. 3. These cost 
elements are grouped into two broad categories, acquisition cost and operational 
cost, a division that adequately encompasses the cost s of most programs. The acquisi- 

7 A planning cost model designed for computer operation is described in M. L. Rapp. M. B. Carpenter. 
S. A. Haggart. S. H. Landa. and G. C. Sumner. Project R-3. San Jose. California:~Eialuation of Results 
and Development of a Cost Model. The Rand Corporation. R-672-SJS, March 1971. 



Acquisition Cost 


Operational Cost 


Design of program 3 ^ 


Program direction 3 


Development of materials 


Evaluation 3 


Evaluation design 3 


Management support 


Program implementation 


Salaries 


Equipment 


Teachers 


Pro gram -related 


Paraprof essionals 


Student -re la ted 


Specialis ts 


Materials and supplies 


Other 


Program— related 


In-service training 


Student-related 


Materials and supplies 


Pre-service training 


Program-related 


Facilities (space) 


Student-related 


Ins tallatlon 


Equipment 

Replacement 
Maintenance 
Facilities O&M 
Contracted services 
Media services 
Transportation 



a ln an operational program, as opposed to a dem- 
onstration program, there might be no program cost 
associated with these activities. 



Fig. 3 — Cost element structure for educational programs 



tion cost is the one-time cost to acquire a capability. The operational cost is the 
continuing cost of maintaining a capability over a period of time. 

In practice, the acquisition cost is also referred to as initial, investment, or 
capital cost. It covers the cost of all resources needed to acquire a capability; it should 
also include the cost of the effort devoted to research, development, or design of 
program components a^d alternatives. The cost of designing a new mathematics 
curriculum, for example, is a development cost. In estimating the comparable re- 
plication cost, however, some overall development costs might be treated as sunk 
costs. That is, the first program to use the new curriculum would incur this expense, 
but subsequent uses would inherit it cost-free. On the other hand, if the curriculum 
had to be redesigned for a particular program, this would be a development cost for 
that program. 

The operational cost is also referred to as the recurring or continuing cost to 
maintain the capability. It includes, for example, maintaining equipment and in- 
service training. 

Figure 3 identifies some cost categories that possibly might be incurred for an 
operational program. They can be characterized as the cost of activities rather than 
of items. In many instances, the items purchased clearly underlie the cost of activi- 
ties, but the activity cost itself can be used directly in estimating the program cost. 
For example, the evaluation cost of a program might be estimated by using a factor 
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such as cost per student; or the cost per program might be used if the evaluation is 
done by an outside contractor or evaluator. If appropriate, these would be the factors 
used to estimate the operational cost of evaluation. The acquisition cost — the non- 
recurring cost — for evaluation might be based on the district stafftime to design the 
evaluation or might simply be the cost charged by the outside evaluator. The cost 
basis for these inputs would be per program for acquisition cost and per student or 
program for the operational cost. 



Cost Basis for Inputs 

The cost basis for all inputs for the categories in the cost element structure is 
shown in Table 1. For each category the cost basis is either per student, per program, 
per unit, or direct service charge. The first two are self-explanatory. The per unit 
basis refers to units such as classrooms, resource centers, and language laboratories. 
The service basis is used for services performed either by the district (such as the 
operation and maintenance of the facilities) or by an outside source (such as special 
bussing or cable TV in the classrooms). 

In some cases, the cost input basis might be a combination of program and unit 
(classroom), of student and service, or of program and service. No rigidity is implied. 
The intent is to provide an understanding of how the model inputs are categorized. 
At this time, it is only necessary to emphasize that some level of input is required 
on account of there being a certain number of students, and other levels of input are 
required because there is a certain number of classrooms or instructional centers. 
In many cases, there is a program cost that is independent of the number of either 
students or centers. Such a program cost can be treated as both an output and an 
input, or in the jargon of model ; ng a "throughput,” as illustrated below. 



Outputs and Inputs of the Model 



A program-related cost can be a direct or indirect output of the model. For 
program development, for example, the direct output would be the same as the input 
cost. The cost of pre-service training for teachers would be an indirect output — that 
is, the cost is calculated within the model. If the model were computerized, the direct 
output would be called a throughput. The physical descriptors of the program and 
cost factors, such as number of teachers, number of students, salary cost, cost per 
mile, space requirments, and the like are the inputs to the model. The objective is 
to keep the number of inputs to a workable minimum while allowing enough input 
flexibility to provide useful outputs of the model for evaluation and planning. 

The outputs of the model are, in general, the resource and cost information 
about the specific educational program. The descriptors of the program are shown 
right along with the cost output . The purpose is to provide, in one place, an estimate 
of the comparable replication cost and a description of what is being bought. As this 
practice becomes more prevalent, the use of a cost per student to describe an un- 



Table 1 



THE COST BASIS FOR INPUTS 



Category 


Cost Basis 


Student 


Program 


Unit 


Service 


Acquisition cost 








- 


Design of program 




X 






Development of materials 




X 






Evaluation design 




X 






Program implementation 




X 






Equipment 










Prog ram- related 




X 


X 




Student-r elated 


* 








Materials 










Program-related 




X 


X 




Student-related 


X 








Pre— service training 




X 




X 


Facilities 


X 








Installation 






X 




Operational cost 










Program direction 




X 






Evaluation 


X 


X 






Management support 




X 






Salaries 










Teachers 


X 








Paraprofessionals 


X 








Specialists 


X 


X 






Other 


X 


X 






In-service training 




X 




X 


Materials and supplies 










Program— re lated 




X 


X 




Student— related 


X 








Equipment 










Replacement 






X 




Maintenance 






X 




Facilities O&M 








X 


Contracted services 


X 






X 


Media services 


X 






X 


Transportation 


X 






X 
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known quantity will decrease and the quality of information available to the educa- 
tional planner will increase. 

The output of the model is illustrated in Figs. 4 and 5. Notice the similarity of 
the format to the cost element structure of Fig. 3. More detailed information for any 
of the items shown can be provided in supporting reports. F or example, the resources 
and cost underlying the cost per student-hour under Media Services might be of 
interest for some types of decision. The supporting detail for this would follow the 
same cost element structure used for estimating the cost of the entire educational 
program. 

The model inputs fall into three broad groups: (1) physical descriptors; (2) the 
cost of resources and services; and (3) the factors or estimating relationships. To 
repeat, these inputs describe the students, the educational program, and the re- 
source requirements. Inputs are required for all the changes, or variables, that 
differentiate one program from another. 



Structure of the Model 

The model integrates the program description, in terms of resources required, 
with the process of estimating the program cost. The model's framework for estimat- 



Program: 
Staffing: 
Facilities : 
Equipment: 
Materials : 



Description of Program 

Objective : 

Student Characteristics: 

Operational Characteristics: 
Instructional time 
Student grouping 
Location 



Acqzii.si.ti.on Cost 



Program activities $ xxx 

Equipment xx 

Facilities xx 

Materials xx 

Total acquisition cost $ xxxx 

Opera tionaZ Cost 

Program activities $ xxx 

Salaries xxxx 

Materials xx 

Supplies xx 

Equipment xx 

Other support xx 

Total operational cost $xxxxx 



Fig. 4 — Summary output of the model 



Acquisition Cost 



Program Activities: 

Design of Program $ xxx 

Development of Materials xxx 

Evaluation Design xxx 

Program Implementation xxxx 

Pre-service Training xxx 

Installation xxx 

Total 

Equipment : 

Program-related - - $ xxx 

Student-related xxx 

Total 

Facilities : 

Student-related $ xxx 

Total 

Materials : 

Program-related $ xx 

Student-related xx 

Total 



Total Acquisition Cost 

Operational Cost 



Program Activities: 

Program Direction $ xxx 

Evaluation xxx 

Management Support xx 

In-service Training xx 

Facilities O&M xx 

Contracted Services xx 

Media Services xx 

Transportation xx 

Total 

Salaries : 

Teachers $ xxxx 

Specialists xxx 

Paraprofessionals xxx 

Other xxx 

Total 

Materials : 

Program - $ xx 

Student - 

Total 

Supplies : 

Pro gram $ xx 

Student xx 

Total 

Equipment : 

Replacement $ xx 

Maintenance xx 

Total 



Other Support: 

Total Operational Cost 




$xxxxx 



$ xxxx 



xxx 



xxx 

$xxxxx 



$ xxxx 



$ xxxx 



$ xxx 



$ XX 



$ XX 
XX 

$xxxxx 



Fig. 5 — Detailed output of program cost estimate 



ing acquisition and operational costs is shown in Figs. 6 and 7; Figs. 8 and 9 describe 
their data requirments. For each cost category there is an estimate of cost on either 
a student, program, unit, or service basis. In the case of units, the estimate can 
be the cost per teacher, the cost of the equipment per classroom or instructional 
center, or the cost per student of materials consumed. For some cost categories, the 
estimate can be based on an overall program cost. For example, pre-service training, 
if done by an outside contractor, might be a total cost for the program. It could also 
be a cost per teacher. 

Under "Materials,” it may be necessary to estimate the cost of student-related 
materials, classroom materials for use by many students, and program materials 
used by the staff in conducting the program. The same practice is followed for the 
operational costs in Fig. 7. 



Cost Category 


$ per 
Student 


$ per 
Program 


$ per Unit 


$ per 
Service 


Design of program 




X 






Development of materials 




X 






Evaluation design 




X 




X 


Program implementation 




X 






Pre-service training 




X 


$/ teacher 


X 


Installation 




X 


$/ecuipment 




Equipment 


X 


X 


$/claSsroom 










$/resource center 




Facilities 


X 




$/resource center 




Materials 


X 


X 


$/ classroom 




Other support 


X 


X 


$/classroon 


i x 



Fig 6— The planning cost model: acquisition cost 



USE OF THE PLANNING COST MODEL 

Estimating the Comparable Replication Cost 

The use of the model will be illustrated by estimating the comparable replica- 
tion cost for several different programs. Again, we emphasize that comparable re- 
source prices and salaries have to be used in comparing programs for different 
districts. A comparison of actual costs would have little meaning, since programs 
differ not only in their configurations but in teacher salaries and other local prices. 

As shown in Fig. 1, the process of estimating the comparable replication cost 
and the incremental cost begins with a description of the program (see Fig. 2) and 
its resource requirements. This information is then processed through the model to 
estimate the cost. 



Cost Category 


$ per 
Student 


$ per 
Program 


$ per Unit 


$ per 
Service 


Program direction 




X 






Evaluation 




X 




X 


Management support 




X 




X 


Facilities O&M 






$/space 


i 


Contracted services 








X 


Media services 








X 


Transportation 


X 


X 






Salaries (including 










fringe benefits) 










Teachers 






$/teacher 




Specialists 






$/specialist 




Paraprof essionals 






$/ aide 




Other 






$/type 




Materials 










Program-related 


X 


X 






Student-related 


X 








Supplies 










Program-related 




X 






Student-related 


X 








Equipment 










Replacement 






$/ unit 




Maintenance 






$/ unit 




Other supper t 


X 


X 


$/unit 


X 



Fig. 7 — The planning cost model: operational cost 



Cost Category 


Data Requirements 


Design of Program 
Development of Material 
Evaluation Design 
Program Implementation 
Pre-service Training 
Installation 


Number and type of personnel, time spent, 
and salary. 


Equipment 


The equipment list is determined for each 
student, for each classroom, and, if ap- 
plicable, for the program. The classroom's 
equipment is used by several classes. The 
number of students that can use the equip- 
ment is specified. 


Facilities 


The space required is that over and above 
the regular program, both for each student 
and for special resource centers. 


Materials 


The initial stock of materials is deter- 
mined for each student, for each class- 
room, and, if applicable, for the program. 



Fig. 8 — Program data: acquisition cost categories 



18 



Cost Category 


Data Requirements 


Program Direction 
Evaluation 
Management Support 


Number and type of personnel, time spent, 
and salary. 


Salaries (with fringe 
benefits) 


All instructional staff and direct support 
classes of staff are identified by broad 
category; i.e*, general teachers, special- 
ists, and aides are used, rather than a 
teacher with a specific salary. Fringe ben- 
efits are included at the district percent- 
age factor. 


Materials and Supplies 


The type and quantity of materials used are 
specified on a student and program basis. 


Equipment 


The equipment maintenance factor and the re- 
placement factor (based on the estimated 
lifetime of the equipment) - 


Facilities 0&M 
Contracted Services 
Media Services 
Transportation 


Square feet maintained, services purchased, 
number of hours of audiovisual instruction, 
and bus trip mileage. 



Fig. 9 — Program data: operational cost categories 



Table 2 summarizes the program and resource data for several illustrative 
programs. The resource requirements are estimates of what it would take to repli- 
cate the instructional strategy of the program. The information unde 1 " Other Sup- 
port” at the bottom ofTable 2 provides an example. The replicated program provides 
eight days of consultant services for the year (an estimate of what might be needed 
in a future program, not of what was used in past programs). The same is true for 
Program Evaluation. The presence of this category argues that the district should 
continue to evaluate the program during operation, even after turnkeying. Cost per 
student is used here. 

The cost information for these illustrative programs is shown in Table 3. These 
are for estimates of the comparable replication cost. This information is combined 
with the program and resource information ofTable 2 and provides the basic inpui 
information for the planning cost model. 

Table 4 lists the standard input costs and the factors for use in the planning cost 
model. The term "standard” applies to a factor used across all programs. In estimat- 
ing the incremental cost of a district program, resource prices and factors specific 
to that particular district are used with the planning cost model. 

^8 



Table 2 



PROGRAM RESOURCE REQUIREMENTS 



Item 


Program A 


Program B 


r 

Program C 


Program D 


Program E 


Program F 


iVljti her of students 














Reading 


350 


285 


491 


150 


103 


250 


Hath 


350 


285 


535 


150 


103 




Instructional time (hr) 














Reading 


1 


1 


1 


1.25* 


1.25 


I 


Math 


1 


1 


1 


1.25 


1.25 




Fad Z i tie a 














Space 


4 trailers , 


4 trailer*. 


2 agl centers,** 
1 dbl center. 


1 classroom. 


1 classroom. 


2 classrooms 


1 classrooms. 


1 claaarooa, 


, 1 activity area 


1 activity area 






900/1000 


1600/1000 


1 reinforcement 








Total square feet 


5600 


4600 


8000 


2000 


2000 


2000 


Ai r-c oodl t i one d 


X 


X 


X 


X 


— 


X 


Carpeted 


X 


X 


X 


X 


X 


X 


Special wiring 


X 


X 


X 


X 


X 


X 


Ca rre la 


X 


X 


X 


X 


X 




Tables 


X 


X 


X 


X 


X 


X 


Utili.xc.tior. 














Time in use 


3(2-hr)ahif ta 


3(2-hr)ahif ts 


7 periods 


5* 


5 


5 


Students /in* t ructions 1 unit 


20 


20 


40-S, 65-D 


50 


50 


25 


Area/atudent (aq ft) 


50 


50 


5C 


40 


40 


40 


Staffing 














Teachera/center or unit 


1 


1 


1 


1 


2 


1 


Paraprof eaa ion* la /unit 


1 


1 


1 


2 


3 


1 


Students /teacher 


20 


20 


40/60 


50 


50 


25 


Teachers /program 


6 


5 


4 


1 


1 


2 


Paraprof loom la /program 


6 


5 


5 


2 


3 


2 


Other direct 


— 


— 


— 








Equipment (major items) 


Dorse tt H-86, 


EDL AUD-X, 


Hoffman readers. 


Telex, 


Telex, 


Caaaette 




teaching 


controlled 


tape recorders. 


caaaette 


esaaette 


playara. 




machine 


readers , 


flash— card readers. 


recorders. 


recorders , 


tape recorder* 






Tach-X, 


Borg- Warner 80 


tape recorder* 


tape recorders. 








Flash— X 


(backup) 




language master 




Materials 














Program- re lated 


Films trips , 


Films trip r , 


Hoffman material*. 


BRL materials. 


BRL material*. 


Filmstrips , 




records , 


discs , EDL 


EDL materials. 


cassettes , 


caaaettea. 


esaaettea. 




Dorse tt 


material* 


great variety. 


variety of other 


variety of other 


paperbacks 




material* 




Borg— Warner ma- 














terial * 








Student- re la ted ( con- 














sumables) 


X 


X 


X 


X 


X 


X 


Pre-service training 








1 week 




1 weak 


Teachc.'a 


2 weeks 


1 week 


2 weeks 


1 week 


P a rap ro f e a a ioaala 


2 weeks 


1 week 


— 


1 week 


1 week 




Other ataff 


— 


— 


— 


1 wee* 






In-rervioe training 


5 day* 


— 


2 hr/wk 


4 days 


3 day a 


3 day* 


Other support 

Student dlagnoatic services 


_ 


_ 





c 

X 


c 

X 


— 


Program evaluation 


X 


X 


X 


— 


X 


x 


Consultants 


8 days 


8 days 


3 days 


8 days 


8 day* 


8 days 



*Tvo 75-minute period* for grade* 1-4 with reinforcement in regular class** - One 2.25-hour period for grade* 5 and 6. 



**Each center has an instructional area plua an activity area. 
c Re» 50 te diagnostic and prescriptive service*. 
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PROGRAM COST INFORMATION 
(Coats in $) 




§ 



o 

JZ 



<o 

u 



o 

«c 



u 



O tM 




21 







Forty students per single center, sixty-five per double. 
^Includes time for paraprofeaslonai training. 

Includes salary, materials, and training costs. 

Remote diagnostic and prescriptive services. 



Table 4 

STANDARD RESOURCE COSTS AND FACTORS 
(Costs in $) 



Facilities 

Remodeling (including carpeting, 

air-conditioning, etc.) $3 ,000/center 

Furnishings (including carrels) $2 ,000/cer.ter. 

Equipment 

Replacement 102 

Maintenance (depends on estimate of 

reliability based on complexity) 10 or 20 Z 

Materials 

Attrition from use, theft 102 

Consumables $10/student 

Salaries (including fringe benefits ) 

Teachers $12, 000/year 

Paraprofessionals $5 ,000/year 

Specialists $12, 000/year 

Program directors $15, 000/year 

General support $10, 000/year 

General administrative $12, 000/year 

Consultants $100 /cay 

Pre- and in-service training (including 

salaries y materials y training) $200/ day 

Program evaluation $10/student 



The model uses $12,000 a year as the standard teacher salary- This includes 
fringe benefits (fixed charges in most district accounting systems). This standard is 
obviously out of line for, say, a small rural district in the southeastern part of the 
country, but since it is used for all the programs, disparities ir. salary cost actually 
reflect differences in the number of teachers needed . The same point applies to all 
other standard resource costs and factors. 

The comparable replication cost for each of the illustrative programs is given 
in Table 5. Table 6 aggregates and summarizes those costs along with the salient 
dimensions of the programs. 

Arriving at the operational cost per student per subject as in Table 6 enables 
a quick comparison of the merits of the programs. The o^her data can be used 
similarly, but such rules of thumb must be used with caution; they are no substitute 
for the results of careful analysis. 
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Remote diagnostic and prescriptive services, 
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In addition to the centers, there is one reinforcement area, 

’The instructional center is augmented by an activity area of equivalent size. 
The instructional center is the basic provisional unit for acquisition cost, 
^Forty students per single center, sixty-five per double center, 

Reading and mathematics for all programs except Program E, 



For example, the acquisition cost per student could be obtained, it seems, simply 
by dividing the acquisition cost by the number of students. The problems lies in just 
what "number” of students to use. If one uses the total number of students in all 
the instructional periods (or other such time division), the acquisition cost per 
student reflects a 1 : iplicit utilization rate for the instructional center. A case in 

point is Program j^: Table 6. In that program, the instructional centers are used 
seven periods (or each day. In current practice, that is the maximum utiliza- 

tion rate for facilities in any one day. In Program A, on the other hand, if the 
instructional centers had been used for seven periods instead of six, one less instruc- 
tional center would have had to be furmshed. 

If the number of students per instructional center is assumed to be the "best” 
figure, then the acquisition cost cn a per-sfudent basis for each instructional center 
fcr each program can be obtained a; id qualified by stating the utilization rate of the 
instructional centers. Use of the acquisition cost per student per program is hazard- 
ous, however, because the equipment and materials purchased for one year will have 
more than one year’s service if the program is continued. 

Estimating the Incremental Cost 

The comparable replication cost serves as an "index” cost for use in comparing 
different programs. It does not reveal what a new program might cost if imple- 
mented in a specific school district; for this purpose the incremental cost must be 
determined. The incremental cost to the district is necessary in deciding whether 
the district can afford a program similar to a successful program in another district. 
It is further necessary when deciding on the scope and design of a program that can 
be accommodated within the resource constraints of the district. 

Both incremental cost and comparable replication cost are estimated by essen- 
tially the same process. The emphasis is on estimating resource requirements and 
translating them into cost estimates. In some districts, the unavailability of certain 
resources might obstruct the implementation of a program even though the district 
could afford the program in an accounting sense. This possibility makes it all the 
more important to estimate the physical resources needed. 

The remainder of this appendix is devoted to explaining procedures for estimat- 
ing the incremental cost of a program. By way of introduction, a short discussion 
of the theory of incremental cost and how it relates to the comparable replication 
cost concept may be helpful. This subsection attempts such an introduction. 

In estimating the incremental resource requirements, the resources available 
within the district at no additional cost are taken into account. Examples are assets 
inherited from discontinued programs, physical resources provided cost-free by the 
community, and volunteer services. After the net incremental resource require- 
ments are determined, district-specific resource prices and cost factors are used to 
develop the estimated incremental program cost, using the methodology of the 
planning cost model. Specifically, the standard resource costs and factors shown in 
Table 4 are changed to district-specific costs. 



To illustrate the process and considerations in estimating the incremental cost 
of a program, the data for Program E (shown in estimating the comparable replica- 
tion cost) will be used- These data are shown in Tables 7, S, and 9. For this illustra- 
tion. it is assumed that information about all the programs, A through F. is available 
and that Program E is tentatively the preferred program. It is assumed that the 
district's current salary schedule sets average teacher salary at S9000 and para- 
professionals at $4000, and much equipment and materials are available within the 

district. , . 

A district computing incremental costs determines the resources available 

within its inventory and matches this information with the resource-: required to 



Table 7 

PROGRAM AND RESOURCE INFORMATION FOR PROGRAM E, AN ELEMENTARY 
LEVEL READING AND MATHEMATICS PROGRAM 



Charaateristioa of students Grades 2-4; Tide T; low socioeconomic 

status 



Program scope 

Class time 

Number of students ... 
Students /instructional 
Number of sections ... 
Utilization 



area . . . . 



1.25 hours reading; 1.25 hours math 

103 

50± 

2 

5 hours per day 



Fad, Z'it'ies 
Space 

Furnishings 



2000 sq ft; 1 instructional area; 

1 activity area 

6 carrels; carpeting; tables and chairs 



Staffing 

Certified teachers 
Special teachers . 
Paraprof essionals 



1 per instructional area 
None 

2 per instructional area; 1 per activity 
area 



Equipment 



a 



Telex (remote diagnostic) ; tape recorders 
cassette players; headsets 



Materials - 

Pro -service tra'in'Lng < 

In- service tra'in'Lng 

Other support 

^Quantity and quality of 



Books; games; incentives 

5 days (formal) 

3 days (formal) 

••••.. Remote diagnostic— pres criptive services 

items would be specified in supporting lists. 




Table 8 



COST INFORMATION FOR PROGRAM E 
(Costs in $) 



Facilities cost 

Total program cost 7.500 

Cost per Instructional area a 5,000 

Equipment cost 

Total 2,000 

Cost per instructional area a 2,000 

Number of Instructional areas l a 

Students per instructional area 50 

Replacement factor 10% 200 

Maintenance factor 10% 200 



Materials cost 

Total 8,600 

Cost per instructional area 8,600 

Number of Instructional areas l a 

Consumables ($ per student) 10 



Pre-service training 
Number of staff-days 

Cost per day c 

Total cost 

In-service training 

Number of staff-days 

Cost per day 

Total cost 

Other support 

Student diagnostic services 50 a 

Program evaluation ($ per student) ... 10 

Consultants ($100 per day) 8C0 

a 0ne instructional plus one activity area. 

^Includes time for paraprof essional staff. 

C Includes salary, materials, and training costs. 

^Contracted diagnostic and prescriptive services. 



b 20 

200 

4,000 



12 

200 

2,400 



Table 9 



COMPARABLE REPLICATION COST FOR PROGRAM 2 
(Costs in $) 



Acquisition cost 

Facilities (remodel/fumish) 

Total program cost 7,500 

(Cost per instructional area) (3,750) 

Equipment 

Total program cost 2,000 

(Co 3 t per instructional area) (2,000) 

Materials 

Total program cost 8,600 

(Cost per instructional area) (8,600) 

Pre-service training 4 »000 

Total acquisition cost 22,100 

Operational cost 

Salaries (including fringe benefits) 

Teachers ($12 ,000/year) 12,000 

Paraprof essionals ($5 ,000/year) 15,000 

Other (variable) — 

Materials 

Program— related (10%) • •• S60 

Consumables (student— related) 1,030 

Equipment 

Replacement (10%) 200 

Maintenance (10%) 200 

In-service training . . 2,400 

Other support 

Student diagnostic services 3 . . 5,000 

Program evaluation • . . 1,000 

Consultants _ § 22 . 

Total operational cost 38,490 



diagnostic and prescriptive services by contracted 
services - 



implement and operate the program. The resulting resource requirements are tran- 
slated by means of the planning cost model into an estimate of incremental cost, 
using district-specific resource prices and factors. 

The data needed and the results of the incremental cost analysis for the various 
configurations of Program E are presented in the same formats as Tables /, 8, and 
9. As an illustration, the incremental cost for two program configurations (160 
students and 200 students) is shown in Table 10. The assumptions, incremental 
resource requirements, and district-specific resource prices supporting the cost esti- 
mates would be displayed, in practice , in the formats of Tables 7 and 8. In this 
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illustration, most of the information can be identified in Table 10. Briefly, the 
district has in inventory about 50 percent of the required equipment for a program 
of 100 students. Adequately remoaeled space is available for one instructional area 
and one activity area; but two instructional areas and activity areas are needed for 
160 students. Only carrels have to be purchased in order to furnish as many as four 
centers. For one configurati on, the district looks at the cost impact of developing an 
in-house capabh.ty fo; the diagnostic-prescriptive services that are provided to the 
other configurations on a contracted basis. This leads to an increase in the cost of 
pre-service training and the additional operational cost for staff members to provide 
this program-related service. 

The resulting program cost analysis provides the information the district needs 
in deciding whether to implement the program and, if so, what configuration it can 
afford. 



Table 10 

INCREMENTAL COST ESTIMATES FOR THREE CONFIGURATIONS OF PROGRAM E 

(Costs in 



Program Cost Category 


E i 

(160 students) 


E 2 

(200 students) 


E 3 

(160 students) 


Acq 


uisition Cost 







Fa<_ lities (remodel/f umish) 

(1 instructional and 1 activity 
area have to be remodeled) 


3,500 


3,500 


3,500 


Equipment (unit cos t /instructional 
area for AO students is $2,000) 


3,000 


3,800 


3,000 


Materials (unit cost/instructional 
area for 40 students is $6,500) 


13,000 


17,200 


13,000 


Pre— service training (5 days/staff 
member and training of 40 days for 
diagnostic services in E^) 


4,000 


8,000 


12,000 


Total acquisition cost 


23,500 


32,500 


31,500 



Operational Cost 



Salaries 






18,000 


Teachers (at $9,000) 


18,000 


18,000 


Paraprof essionals (at $4,000) 


8,000 


24,000 


8,000 


Other (at $5,000, one-third time) 


— 


— 


— 


Materials 








Program-related 


1,300 


1 ,72C 


1 , 300 


Consumables 


1,600 


2,000 


1,600 


Equipment 






400 


Replacement 


400 


500 


Maintenance 


400 


500 


400 


In-service training 


3,200 


6,400 


3,200 


Other support 


8,000 


10,000 




Student diagnostic services 


— 


Program evaluation 


1,600 


2,000 


3,200 


Consultants 


800 


800 


800 


Total operational cost 


43,300 


65,920 


41,900 
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Two points should be made clear. First, the cost estimates developed above are 
planningc ost estimates. Much greater detail and accuracy are required to meet the 
needs of planning for actual implementation. Second, analysis of the dollar-cost 
alone does not provide adequate information for educational decisions. For these 
reasons, it may be helpful to the reader to examine the detailed example below of* 
the type of analysis needed for planning the implementation of a program in a 
specific district. 



An Example of Incremental Cost Analysis 

At the expense of some redundancy, then, the following pages present incre- 
mental resource analysis in seven steps, briefly described and illustrated with some 
hypothetical figures for a candidate program:* 

1- Summarize the program’s resource requirements 

2. Derive resource factors 

3. Describe the scope of the planned implementation 

4. Project resource needs from Steps 1 and 2 

5. Delete resources to be supplied by contractor or to be otherwise available 
without cost 

6. Summarize the impacts on resource inventories and personnel 

7. Display program costs 

Using data provided by the example, a worksheet has been prepared to illustrate 
each of these steps. 

Summary of Candidate Program. The first task is to systematically catego- 
rize the identifiable resources required for the program, excluding, however, the 
resources required for general building maintenance, heating, district overhead, 
regular pupil transportation, and like expenditures that would be required for any 
program. Program-specific resources can be divided into seven functional categories: 

• Staff 

• Facilities 

• Equipment 

• Furnishings 

• Instructional materials 

• Training 

• Direct program support 

Staff includes teachers, aides, secretaries, and on-site managers or directors. All 
personnel with regular duties in the candidate program are included, whether paid 

H The hypothetical figures are roughly based on the Combined Motivation Education System <CMES? 
program in Grand Rapids. See G. C. Sumner. Case Studies in Educational Performance Contracting: 6. 
Grand Rapids , , Michigan. The Rand Corporation. R-900/6-HEW. December 1971. 




by the district or by the contractor. This includes any district personnel who are 
assigned by the district to monitor or supervise the program, but excludes consult- 
ants and training specialists who serve the program only periodically. 

Facilities include capital expenditures, physical space such c.s classrooms and 
offices, and remodeling costs. Items with less than ten-year serviceable lifetimes are 
excluded. 

Equipment includes instructional hardware items. 

Furnishings include ail furniture and all noninstructional equipment that are 
removable (such as air conditioners) or that have serv iceable lifetime less than ten 
years (such as carpet ing). 

Instructional /??ater/a/scan be consumable (such as workbooks) or nonconsuma- 
ble (such as filmstrips), and may be independent (such as textbooks) or hardware- 

related (such as cassette tapes). 

Training includes pre-service and in-service training. 

Direct program support includes management support, instructional consulta- 
tion. and other costs incurred at the contractor’s home office. A Program Summary 
is provided in Table 11. 

Derived Resource Factors. Using the Program Summary as a guide, the 
next task is to express each resource used in the candidate program as a factor of 
whatever program characteristic is most closely related to the need for that re- 
source. Consumable materials will ordinarily be expressed on a per-student basis; 
most equipment will be on a student-per-session basis. Some resources may be 
related to other resources. For example, the number of paraprofessionals may best 
be related to the number of classrooms, which, in turn, depends on the number of 
students, the number of sessions per day, and the class size. 

A unit cost for each resource item should be estim^ed. as well as a yearly 
replacement factor for those items that are consumable are vulnerable to wear 
and tear- 

Table 12 lists the unit costs, resource factors, and replacement factors for the 
example. The replacement factors are multiplicative. For example, if the replace- 
ment factor is 0.2, a combined factor can be obtained by multiplying the resource 
factor by 1.2. 

Description of Planned Implementation of Program. The scope of the 
planned program must be described in terms of those program characteristics that 
generate needs for resources. The most important is the number of students. Also 
impc tant are the length of time each student will need in the program classroom, 
the number of students per session, and the number of sessions per day. The age 
groups of the participants should be included, and it should be noted whether the 
organization of the candidate program differs significantly from the distriCcS 
planned implementation, because these features can affect costs. Assume Uiat the 
intent is to implement a program with the following characteristics. 



Table 11 

CANDIDATE PROGRAM SUMMARY 



Characteristics of students . Grades 6-9; remedial program 

Pro gram scope 

Number of students (as 

of midyear) 491, reading; 535, math 

Class time 45 minutes per day each, reading and math 

Class size 35-40 in Single Center (SC) (40 optimum) ; 

60-65 in Combined Center (CC) (65 optimum) 
Number of sessions 3 14 each subject (7— period day) 



Facilities 
Space . . 



Students /classroom 
Furnishings 



4 centers: 1 CC for reading and math ; 

1 SC for reading and 1 SC for math; each 
center has an instructional and an AMS 
(achievement motivation) area; 1 reinforce- 
ment room; total occupies space of 7 former 
classrooms (walls were changed) 

Number of enrollments /number of classrooms " 
(491 + 535) /7 - 1U7 

Table space for carrels; carpeting; air- 
conditioning; 1 carrel per student per 
section (approximately 125 total) ; chairs 



Staffing 

Certified teachers 1 per center (i.e. , 1 per SC, 2 per CC) 

Special teachers 0 

Paraprofessionals Full-time: 1 per center, 1 for reinforcement 

room, 1 substitute 

Other personnel 1 full-time director, 1 full-time secretary 

Equipment Reading: 40 Hoffman reading machines, 25 

tape recorders/center (50 total) ; math: 40 
tape recorders /center (80 total) , 40 math 
flash-card readers (Electronic Futures) ; 

15 Borg -Warner System 80 for reading and math 



Materials (102 consumable) 



Reading . 2 sets EPL tapes /center ; 2 sets Hoffman ma- 

terials (levels B to G) /center; workbooks 

Math Math minisystem (tapes); workbooks 

Reading and math 2 sets Borg-Wamer materials (levels 1-8)/ 

reading and math center (i.e., 4 complete 
sets); 1 notebook/student for compiling 



materials 

Pre-service training 1 week on AMS in-depth training, 1 week going 

through materials 

In-service training About 2 hours a week 

Other support See requirements under "St af fing*' ; Management 

Support Group services 

“The number of times the program is replicated with different groups of children. 

For example, the reading centers provide each child with reading instruction in mod- 
ules that are the same length as classroom periods; since the centers operate 7 periods 
per day, each center accot^iodates 7 sessions. 

^The combined center will be regarded as 2 centers, 1 in reading and 1 in math. 
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‘able 12 



DERIVED RESOURCE FACTORS 



Itea Description 


Unit 

Cost 

<$) 


a 

Resource Utilization Factor 


Replacement 
Fac tor a 


Learning centers 


— 


*025 centers^ (25 it c bv 40 ft) per 
instructional unit /sessions per 
dav (round up if above 0.1, or ad- 
adjust center size 


h'A 


AML areas 




.025 per instructional unit/sessions 
per day (in learning center if 
there is space) 


NA 


Relnf orceaent Event 
(RE) room 


— 


1 per school 


SA 


Office-storage room 


— 


I per school 


NA 


Remode ling 


— 


Changing walls, installing partitions 
as required 


NA 


Staff 

Teachers 


10,500 


7— hour cey/6-hour availability ■ 
7/6 teachers* per center^ 


NA 


Aides 


3,000 


1 per center; 1 per RE room; others 
as needed 


NA 


Teacher substitutes 


10,500 


.03 per teacher (district planning 
factor) 


NA 


Aclrrir. is t ration, irith pcr- 
forrxznce contract 
Director 
On-site monitor 
Secretary 


19.000 

16.000 
6,000 


1 per school 
1/2 per school 
1 per school 


Na 


Adrrini stration, without 
pcrf02yrc1r.ce contract 
Director 
Secretary 


16,000 

6,000 


1/2 per school 
1/2 per school 


NA 


Fringe benefits 


— 


16Z of salaries 


NA 


Furnishings 

Carrel furniture , (table , 
chair, side panel, 
electrical outlet) 


75 


.84 sets per Instructional unit/ 
sessions per day e 


0. 1 


AMS furniture (10 chairs, 
1 table) 


200 


1 set per AM5 area 


0 . 1 


RE furniture (6 chairs, 
3 tables) 


200 


1 set per RE room 


0 2 


Office furniture (swivel 
chair, desk, 8 file 
cabinets, storage 
cabinet) 


800 


1 set per office 


NA 


Other furniture (2 chairs, 
2 tables, 3 bookcases) 


, 250 


1 set per center 


0.1 


Air- conditioning units 


600 f 


1 per room (2 for combined center) 


8-yr life 


Carpeting 


6* 5/yd 


All floors except office 




5-yr lift* 
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Table 12 — continued 



I tea Description 


Unit 

Ccst 

($> 


Resource Utilization Factor* 1 


Replacement 

Factor 3 


EquCznent 

Hoffaan reading machines 


[ 400 


40 reading machines 


0. 2 




(490 reading students) /(7 sessions per day) 








— 0.57 machines per reading student per 
sessions per day 




Tape recorders, reading 


25 


50 recorders 


0. 5 






(490 reading students)/ (7 sessions por day) 








• 0.71 recorders per reading student per 
sessions per day 




Tape recorders, math 


25 


80 recorders 

(540 math students)/ (7 sessions per day) 


0. 5 






» 1.04 recorders per math student per 
sessions per day 




Flash-cord readers 


250 


40 readers 

(540 math students)/ (7 sessions per day) 


0 . 1 






- 0.55 readers per math student per 
sessions per day 




Borg— Warner System 80 


500 


15 machines 


0.1 






(1,030 instructional units)/(7 sessions /day) 








- 0.11 machines per instructional unit 
per sessions per day 




RZ equipmen t (record 
player, etc.) 


300 


1 set per RE room 


0.8 


Earphones 


7 


45 earphones 


0.2 




(1,030 instructional units) /(7 sessions /day) 








» 0. 32 earphones per instructional unit 
per sessions per day 




Materials 

E?L tape sets (reading) 


COO 


2 per reading center (RC) 


0.4 


Ocher tape sets (reading) 


600 


1 per RC 


0.4 


Hoffman materials (read- 
ing sets) 


3,500 


2 p«_- RC 


0.5 


Reading software materials 


1,000 


1 set per 500 reading students 


0.3 


Hath minisystem and 
flash-card materials 


2,500 


2 sets per math center (MC) 


0.4 


Other tape sets (math) 


600 


1 set per MC 


0.4 


Math software materials 


2,000 


1 set 500 math students 


oo 

o 


Borg— Warner materials 


2,300 


g 

2 sets accommodate 1 RC and 1 MC 


0.5 


RE supplies (games, etc.) 


100 


1 set per RE room 


0. 8 


Student notebooks 


0.5 


1 per pupil (including AMS only) 


N'A 


Diagnostic and prescrip- 
tive materials 


1,000 


1 set per AMS area 


SA 


Office supplies and 
expense 


1,600 


1 per 1,000 instructional units 


NA 
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Table I? — cor :*: 4 . n-jeci 



Item Description 


Unit 

Cost 

($) 


Resource Utilization Factor 


Replacement 

Factor* 


Start-up trorlni.no and 

cc Mo uZtatz. on (teachers 
and Program Managers) 


6,000 


Fcr district 


SA 


.ycznaecnen t support 


— 


Varies widely 


SA 


Staff expense 


1,200 


For district (4-8 learning centers) 


SA 

1 


Ir-cert'io-- training, con- 
sult at ion and contrac- 


7,500 


For district (4-8 learning centers) 


NA 


Cv erne ad end other chorees 


— 


jOl of contractor costs 


NA 



^he factors represent the author’s judgment of appropriateness for Che respective 
resource categories; in several cases, they do not reflect the actual resource utili- 
zation of the Grand Rapids program. 



^Assumes AO students per center per session, iron Table 11. 

c Fo r example, if a student receives both reading and math instruction in the program, 
he is enrolled for two units. 

S'his formula provides for both teacher supervision of each center at all times and 
a free preparation hcur for teachers. The implication is that in cost applications 
one teacher should be assigned to the program or. a part— time basis. (The Grand Rap*ds 
program did not provide completely free preparation time.) 

e AC anv one time, 802 of the students are actually receiving instruction. ihe 
remainder are in AMS or in the reinforcement room. To provide a margin for contin- 
gencies we have estimated that 0.84 sets of carrel furniture should be provided per 
instructional unit. 

f Ins tallacion costs van’ widely, depending on the amount of rewiring necessary to 
accommodate the heavier load. 

®Each 3org-Wamer set contains materials for reading and math. If the learning 
centers accommodate from 20 to 45 students per session, two Borg-^amer sets will be 
recommended for each pair of centers (one reading and one math) in order to minimize 
waiting time for students using the materials. 



1. An inner-city school, grades 6-9 

2. Seven classroom periods per day 

3. Classroom size is 25 by 35 ft 

4. Expect to turnkey program after one year 

5. Expect to decrease program scope in third year 

6. Serve lower achievers, scholastically 



7. 


Year 


X umber of 
Participants 


Grades 


Instructional 
Units 9 




1 


600 


6-9 


1200 




2 


600 


6-9 


izOf 




3 


300 


6-7 


0600 



,J Evenly divided between reading and math. 



0 
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8. Basis of interyear comparisons to be reading and math instruction for 600 
students 

Since the number of students in the program decreases in the third year, the district 
will need to designate a common basis for interyear comparisons, r or simplicity, this 
example will use the maximum number of students served during any one of the 
three years. Accordingly, the final worksheet will estimate the out-of-pocket costs 
of providing reading and math instruction for 600 students in grades 6 to 9, even 
though in the last year some of those costs will be for students in regular classrooms. 
Looking at it another way, the planning is for 600 students for three years: in the 
third year, half" of those students are to receive regular instruction. 

Calculation of Requirements for Planned Program. The next step is :o 
project resource needs by applying the factors of Table 12 to the proposed program. 
This is done in Tables 13 and 14. Except for items that could conceivably be pur- 
chased in fractional quantities, the results have been rounded to integers. The 
criterion for rounding was reasonableness in view of program needs. For example, 
some items were rounded upward even if the fractional part exceeded onl\ one- 
tenth. 



Table 13 



RESOURCE REQUIREMENTS: FACILITIES 



I tea 


Year 1 


Year 2 


Year 3 


Learning centers 3 


2 reading, 25 x 35 ft 


same 


1 reading, 25 x 40 ft 




2 mach, 25 x 35 ft 


same 


1 math, 25 x 40 ft 




1 combined, 25 x 35 ft 


same 




AMS room 


1 area in each center 


same 


1, 25 x 25 ft, 3 compartments 


RE room 


1, 25 x 25 ft 


1 




Office and storage 


1, 10 x 25 ft 


1 


1 


No. classroom spaces 


6 


6 


4 


Remodeling 


partitions in centers 


— 


tear down, replace two walls 



^he derivations of these configurations are described in the text. 



The configuration of facilities * ? as determined so as to minimize major remodel- 
ing and maximize utilization of staff. The number of students in the planned pro- 
gram is not an even multiple of the 40 students per session premised in Table 12 nor 
are classroom dimensions the same. For these reasons, the facilities planning factors 
were used only as a rough guide. Strict application of the factors for the first year 
obtains: 



Table 14 



RESOURCE REQUIREMENTS : STAFF 



Item 


Year 1 


Year 2 


Year 3 


Teachers 








Regular 


5 


5 


2 


Floater 


1 


1 


— 


Sub 


0.18 


0. lb 


0.09 


AMS 


— 


— 


1 


Aides 








Ins tructiontl 


5 


5 


2 


RE 


1 


1 


0.09 


Director 


1 


1 


1/2 


Secretary 


1 


1/2 


1/2 


On-site monitor 








(asst principal) 


1/2 


— 


— 


F ■ ' nge benefits 3 









a See Table 17. 



600 

.025 ( 1 = 2.2 reading centers 

7 

600 

.025 ( ) = 2.2 math centers, 

7 

where each center is 25 by 40 ft and accommodates 40 students per session. Since 
the fractional parts of these results (that is, 0.2 reading centers and 0.2 math centers) 
are too small to form an e^icient combined center, and since the classrooms availa- 
ble for the planned implementation are only 25 by 35 ft, it seems in the interest of 
efficiency to adjust the above results as follows: 

2 reading centers, each accommodating 35 students per session, 25 by bo ft. 

2 math centers, each accommodating 35 students per session, 25 by 35 ft. 

1 combined center, about 30 students per session (15 in reading and 15 in 
math), 25 by 35 ft. 

This arrangement groups students more equally and eliminates the need for mov- 
ing classroom walls. 

Since only half as many students are involved in the third year and thereafter. 
Table 13 suggests that three of the learning centers be remodeled to provide one 
reading center and one math center, each 25 by 40 ft and accommodating 44 stu- 
dents per session. The remaining 25 by 25 ft ^;pace would provide a separate space 
for AMS sessions so that the learning centers would be less crowded. 

For the Facilities and Staff categories, Tables 13 and 14 state the quantities 
required fo > ~ ^ech of the three years. For the other categories (Table 15) the notions 
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of lifetime and replacement are applicable. Accordingly, for the first year there is 
a column listing resource requirements (i.e.. the level of' resources that must be 
maintained to operate the program) and a column that lists the resources that must 
be made available as replacement items during the school year; in some cases, the 
replacement numbers represent maintenance allowances. For each of the years 2 
and 3. a third column lists the changes in resource requirements over the previous 
years. 

The sum of both first-year columns represents the resources that must be ob- 
tained for that year. For the second and third years, the appropriate columns are 
those labeled "Increase Over Preceding Year” and "Replacement. 

Since the incremental and replacement concepts are not applicable for training 
and consultation expenses, they are omitted. 

Resources to be Acquired. Raving arrived at the schedule of resources that 
must be made available each year, the next step is to substract those that will be 
supplied by the contractor, inherited from the regular program, or made available 
from district inventories. This is done in Tables 16-19. Resource requirements for the 
regular program are included so that base-year nonprogram costs can be obtained 
for comparison. 

In general, the scheme of Tables 16-19 is first to itemize resource requirements 
and costs for regular instruction for the same program scope as thai of the proposed 
innovative program (i.e., 600 students); this is called the base year. Then, for the first 
year of the program, the successive columns itemize (1) the resource needs from 
Tables 13-15 (Resource Requirement plus Replacement, or Increase plus Replace- 
ment), (2) the contractor-supplied items, (3) the district-supplied items, (4) availabil- 
ity of district-supplied items from inventories, (5) resources that must be newly 
acquired, (6) total costs of resources based on unit costs from Table 12 (Net Cost), and 
(7) the quantities of regular program resources that are released because of the 
innovative program. The second and third years are treated similarly, except that 
the "Contractor-Supplied” and "District-Supplied” columns ar omitted; since we 
are assuming that turnkey begins in the second year, all items are district-supplied. 
Note that in year 3, when the number of students in the implemented program is 
smaller than the 600-student base, regular program costs for math and reading for 
the remaining students are included to enable interyear comparisons. Resources 
that are freed during the third year because of changes in scope are noted in tne 
appropriate "Released” columns. 

I incremental Resource and Staffing Requirements. Table 20 summarizes 
changes in district inventories thi t would result from the release cf items to inven- 
tory or withdrawal of items from inventory by the program. Data in the Additions 
and "Reductions” columns were respectively taken from the "Released (by pro- 
gram) and "Available” (from inventory) columns of Tables 16-18. Table 20 would 
provide useful input to the district’s inventory management system. 

Table 21 summarizes personnel changes that result from the program. Negative 
balances indicate the need for hiring new staff or transferring std/f in from other 
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RESOURCE REQUIREMENTS: FURNISHINGS, EQUIPMENT, 

MATERIALS, AND OTHER EXPENSES 
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Other expenses 

Diagnostic, prescriptive 600 
Student notebooks 600 

AMS materials 10 

Office supplies, expense 1/1000(-KH30)“1, 2 
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RESOURCE ACQUISITIONS: FURNISHINGS, EQUIPMENT, AND MATERIALS 
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Regular program. 



Table 19 

RESOURCE ACQUISITIONS: TRAINING AND CONSULTATION 




buildings. Positive balances represent the need to absorb excess staff into other 
programs. 

Estimated Program Cost* Finally, the cost columns of Tables 16-19 are to- 
taled and summarized in Table 22 as the cost to the district of having the progiam 
in operation over a three-year period. For the first year, three estimates of the 
contractor’s fee are indicated, based respectively on low achievement gains <0.3 of 
an achievement year), high gains <2.0 achievement years), and "expected'’ gains <0.8 
achievement years). Payment was calculated assuming a rate of S60 per year s gain 
per instruction unit. The totals indicate the yearly cash outlay required to provide 
reading and math instruction to 600 pupils, plus a large portion of AMS. 

It should be emphasized that the motive here has been to illustrate a format for 
detailed analysis of the cash flow, resource inventories, and staff in a hypothetical 
program. Since programs vary widely in scope, resource prices, and inherited re- 
sources, the totals in Table 22 are not intended as a universal comparison of regular 
instruction with instruction under the planned program, nor would they always be 
appropriate for generalized higher-order planning decisions in contexts of higher 
uncertainty. Those who must make such higher-order decisions would be better 
served by the Comparable Replication Cost procedure discussed earlier. 



As noted above, this illustration has been based on the CMES program in Grand Rapids. However, 
we have freelv altered some of the premises of the example to suit various purposes tic re o.c t 
example cannot be taken as an authoritative picture of the methods and programs of t M Lb > tor example, 
CMES generally prefers to supplv materials and equipment, although in Grand Rapids these ui 
supplied by the district. Furthermore, for purposes of illustration, rather generous allowances were made 
in setting up resource requirements and replacement factors 
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Table 21 



SUMMARY OF CHANGES IN STAFF 






Year 1 


Year 2 


Year 3 


Job Type 


New 

Require— 

Released caent 

O) (-) Net 


New 

Require- 

Released ment 

(+) (-) Set 


New 

Require— 
Released taent 

(+> (-) Net 


Teachers 
Aides 
Director 
Secretaries 
On-site monitor 


8.24 7.21 1.03 

6 -6 

1 -1 

1 -1 

— 1/2 -1/2 


1/2 — 1/2 

1/2 — 1/2 


3.09 4. i: 1.06 

3 — ? 

1/2 — 1/2 



Table 22 

SUMMARY OF COST FOR READING AND MATH INSTRUCTION: 
600 PUPILS IN PERFORMANCE CONTRACT PROGRAM 
AND REGULAR SCHOOL INSTRUCTION 



Item 


Base Year 


Year 1 


Year 2 


Year 3 


Direct district: outlay 
Contractor performance fee 


101,700 


199,100 


191,000 


136,600 


Low (0.3 gain) 


— 


21,600 


— 


— 


Expected (0.8 gain) 


— 


57,600 


— 


— 


High (2.0 gain) 


“ 


144,000 
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Appendix C 

EIGHT ILLUSTRATIVE LEA-LSC CONTRACTS 



NORFOLK-LRA CONTRACT 



AGREEMENT entered into this 23 day of November 1970 by and between 
Norfolk City Schools a duly established school district of tne Common- 
wealth of Virginia (hereinafter referred to as LEA) , and LEARNING RE- 
SEARCH ASSOCIATES, INC., a Corporation duly organized and existing un- 
der and by virtue of Laws of the State of New York (hereinafter referred 
to as the "Contractor’ 1 ) . 



WITNESSETH 

WHEREAS the State Education Agency (hereinafter referred to as SEA) 
has expressed interest in, and given encouragement to, a performance 
contracting project in reading, being conducted with Title I (Elemen- 
tary and Secondary Education Act) funds on a demonstration basis by 
several localities in the Commonwealth of Virginia during the school 
year 1970-71, and, 

WHEREAS the Local Education Agency (LEA) recognizes its duty to 
improve the reading skills of students who are now below standard, 

WHEREAS the project shall continue for the 1970-71 academic year, 
consisting of approximately 350 class periods of instruction in read- 
ing. Management supr *rt will be provided to the LEA and the entire 
project will be eval. ted. 

WHEREAS th< reft ences for parties involved in the project are: 
Contractor — Learning Research Associates, Inc. 

LEA — Local Education Agency, the fiscal agent as designated 
by Title I ESEA Legislation 



SEA — State Education Agency 

Project Coordinator — SEA representative 

Project Director — LEA’s representative 

Project Administrator — Contractor's representative 

Management Support Group — Education Turnkey Systems, Inc. 

Principal offices: 1660 L St. N.W., Washington, D.C. 

Evaluation Contractor — Bureau of Research, School of Educa- 
tion, University of Virginia, Charlottesville, Va. 

WOW, THEREFORE, it is agreed by and between the parties: 

1.01 The term of this Agreement shall be from the date hereof up 
to and including June 30, 1971. 

1.02 The parties hereto understand and agree that this Agreement 
is conditioned upon the signing of a Letter of Agreement be- 
tween the SEA and the Contractor regarding the availability 
of the Title I funds aforementioned. 

1.03 The Contractor agrees to provide High Intensity Learning Cen- 
ters (hereinafter referred to as the Program) for students 
deficient in reading, presently enrolled in public schools 

of the LEA. 

1.04 The Program shall consist of approximately 150 class days, 
each period being of approximately one hour in length, 
through the academic school year 1970-71. 

The Contractor shall: 

o Organize and operate the Program in reading, 
o Install the Program, 

o Monitor and supervise the Program. 

o Train the teachers who are selected for the Program and 
orient management staff selected by the LEA. 
o Assist and guide the teachers in the operation of the Pro- 
gram. 

o Review the performance of the students enrolled in the 
Program. 

o Recommend alternative approaches with regard to the perfor- 
mance of each of the students enrolled in the Program. 
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o Instruct the teachers assigned to the Program in the use of 
the hardware used in the Program, including but not limited 
o, tape recorders and reading devices, 
c create the special environment necessary for the intensive 
learning provided by the Program, 
o Submit an acceptable Management Plan to the LEA and Manage- 
ment Support Group for their use in monitoring the Program, 
o Provide draperies, area carpet and air conditioning in ac- 
cordance with the Contractor’s proposal dated August 13, 
1970. 

1.05 MOREOVER: 

o Contractor agrees to cooperate fully with other contractors 
of the SEA which are responsible for tasks and activities 
directed or approved by the SEA for ensuring the success of 
this project. Contractor will provide necessary informa- 
tion for such parties on a timely basis and during on-site 
visits . 



1.06 
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For the purpose of the turnkey analysis. Contractor shall 
maintain records to reflect all actual start— up and operat- 
ing costs in accordance with reporting forms and procedures, 
and at specified intervals required by Project Coordinator, 
as established by the Management Support Group, Education 
Turnkey Systems, Inc., and LEA. 

o Contractor agrees to supply all data and other in- 

formation required by the Project Coordinator with a copy 
to the LEA for the reporting system and for other uses in 
a manner reflecting the over ii* quality of form and sub- 
stance which can be expected of the Contractor. 

o Contractor further agrees to maintain sufficient personnel 
and equipment required over the full contract period to as- 
sure the maximum possible educational development and super- 
vision of each student. 

LEA agrees to 

o maintain an information exchange jointly developed with 
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Contractor involving teachers, counselors, consultants, and 
parents * 

o host visitors to the program on a pre-determined schedule 
and in accordance with procedures approved by the Project 
Coordinator and LEA in order not to interfere with the 
reasonable, operations of the Program or the LEA, 
o to be responsible for ensuring that any student enrolled 
in the Program and attending school on a given day will 
attend the Program, 

o shall arrange scheduling of classes, where appropriate, to 
facilitate student attendance. 

o make replacement students available whenever they are needed. 
MOREOVER: 

o IRA agrees to naintain, clean and repair in a manner and 
with the level of effort exerted elsewhere in the school, 
the premises, fixtures, furnishings and non- instructional 
equipment occupied, owned or controlled by the Contractor, 
o LEA agrees to provide reasonable security for the premises 
occupied by the. Contractor and further agrees to provide 
at least or.e person two hours a day to perform clerical 
work. Schedule of the clerical services to be performed 
shall be mutually agreed to by the parties hereto, 
o LEA shall owe the same duty of care and responsibility to 
student participants in Contractor's instructional compo- 
nents whether operated during or after regular school hours, 
as it does to those same students when in regular classroom 
situations . 

o LEA agrees to be responsible for ensuring that any student 
enrolled in the Program and attending school on a given 
day will attend the Program, and shall arrange scheduling 
of classes, where appropriate, to facilitate student atten- 
dance, Transportation, if necessary, of the students shall 
be provided by the LEA. Such transportation shall be the 
transportation ordinarily provided by the LEA, 
o LEA agrees to pay to the Contractor the cost required for 
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Contractor to obtain liability insurance on students par- 
ticipating in High Intensity Learning Centers. This cost 
is not to exceed $1.89 per student x 250 students. This 
insurance will render harmless Norfolk City Schools to any 
claim or action resulting from this Program. The insurance 
policy shall be purchased by the Contractor and any liabil- 
ity of the Program shall be the responsibility of the Con- 
tractor . 

It is understood and agreed by both parties: 

o After-school project operating hours shall be jointly es- 
tablished by LEA and Contractor, where appropriate and 
reasonable, to allow students who have been absent to com- 
plete the work they have missed. 

o The teachers involved in the Program should devote their 
full time to it, and agree to use their best efforts in 
regard to same. 

o It is understood and agreed that all teachers participating 
in the Program described herein shall remain employees of 
the LEA and shall not be considered agents, employees or 
servants of the Contractor or its designees. LEA and the 
participating teachers understand and agree that in order 
to effectively execute the Program created, designed and 
administered by the Contractor, directions for the proper 
implementation of said Program must come from the designee 
of the Contractor and the teachers concerned agree to fol- 
low the directions regarding the operation of the Program. 

o The Contractor agrees that it will abide by the general 
rules and regulations of the school board. 

o The Contractor shall reimburse the LEA for the payments 

made by the LEA to the substitute teachers employed by the 
LEA during the training of the teachers selected under this 
Program. 

o The LEA agrees to provide the Contractor with a statement 
of the rate paid to the substitute teachers employed by 
the LEA during the training of the teachers selected under 
this Program. 
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o The LEA agrees to provide the Contractor with a statement 
of the rate paid to the substitute teacher (s) , but in no 
event shall any payment made by the Contractor exceed the 
sum of $35 per day. 

o As set forth in the Contractor’s Proposal dated August 13, 
1970, the Contractor shall provide one week of training in 
the Program for each of the selected teachers, 
o The Contractor may not release test results or cause them 
to be made public in any way except with written permission 
of che LEA and approval by the Project Coordinator, 
o A pre-audit of the Contractor’s instructional program may 
be performed prior to but not later than December 7, 1970, 
to determine that standardized test items are not included 
in the curriculum, with continuing audits to be performed 
thereafter . 

Selection of Students : 

o Students who are potential participants or have been se- 
lected for this Program will have grade level deficiencies 
in reading as determined by any one of three nationally 
norraed, standardized, commercially available achievement 
tests nominated by the Contractor and selected by the 
Evaluation Contractor and administered by the Evaluation 
Contractor or his designee within 12 school days of the com- 
mencement of the Program. Deficient students on this test 
will be assigned to the Program, except such pupils who are 
excluded by the Project Director on account of handicapping 
conditions. For those students and any replacement stu- 
dents who are placed in the Program within thirty days of 
the above testing, those test scores shall be used as the 
pre-test for payment purposes, as provided above, 
o In the St. Helena School, there will be 125 students defi- 
cient in reading, approximately 35 from grade 4, 35 from 
grade 5, and 50 from grade 6, available for entry into the 
ALAC on November 3, 1970. There will also be a pool of 
approximately 50 students deficient in reading available 
as rep 1 ac emen t s . 
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o In the Jacox School, there will be 125 students deficient 
in reading, approximately 50 from grade 7, 40 from grade 
8 , and 35 from grade 9, available for entry into the ALAC 
on October 19, 1970. There will also be a pool of approx- 
imately 50 students deficient in reading available as re- 
placements . 

2.01 During the first ten school days in which a student partici- 
pates in the Program, that student shall receive diagnostic 
testing by Contractor to determine individual treatment. If, 
during that ten school day period. Contractor states in writ- 
ing to the Project Director chat the student is not qualified 
to participate because of emotional or mental reasons unre- 
lated to standardized test results, the Contractor may request 
the student 1 s removal in writing to the Project Director. If 
the matter is not resolved within two days, the Project Di- 
rector shall notify the Project Coordinator and upon the 
Project Coordinator’s determination, an individual test will 
be administered, at the cost of the Evaluation Contractor, 
to that student by a qualified professional employed and/or 
designated by the Evaluation Contractor who shall then make 
a recommendation to the Project Coordinator. In all cases, 
the Project Coordinator’s decision on student participation 
shall be final and binding. Those students remaining after 
the ten school day period shall remain in the Program for the 
full n umb er of class days normally scheduled for the school 
for all students. 

2.02 For the purpose of this contract, the following are the only 
reasons for a student’s leaving the program: commitment to 

institutional care precluding attendance in the Program; re- 
moval from the school district; induction into the armed 
forces; illness or incapacitation for a continuous period of 
ten school days or for intermittent periods totaling fifteen 
days in any three-month period; if parents or guardian request 
removal; removal of student as a direct result of court order; 
or if the student reaches seventeen years of age or withdraws 
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for severe financial reasons. If a student drops out for any 
reason other than the above, the LEA is not obligated to pro- 
vide a replacement. In all cases, Contractor shall give 
written notice to Project Director when in its opinion a stu- 
dent^ absences warrant removal from the Program. Project 
Director shall, if possible, obtain a written statement from 
the parent or guardian as to the reason for the student’s re- 
moval from the Program. The Evaluation Contractor shall cer- 
tify the validity of the cause of the student’s withdrawal 
from the Program. LEA will tarnish daily to the Center 
Teacher the names of any students absent from regular classes. 
The Center Teacher will furnish to the LEA a daily list of 
students absent from the Program. LEA shall use the same ef- 
forts and procedures as are used for all other students in 
the school district to ensure regular attendance and atten- 
dance at make-up and at future sessions. 

If a student leaves the program, it shall be certified in 
writing to the Contractor by the Project Director. A replace- 
ment will be selected from the pool by the Evaluation Contrac- 
tor within three school days and placed in the Program within 
two additional school days by the LEA. Replacement students 
placed in the Program after thirty calendar days from the 
date of pre-testing shall be tested again upon entry into the 
Program. No replacements shall be made later than thirty 
days before the end of the project. If the pool needs to be 
increased, students will be selected for inclusion on the 
same basis as students were originally selected. Final de- 
cision on replacements rests with the Project Coordinator. 
Testing of student progress under the authority of the Project 
Coordinator or its designee shall follow the procedures de- 
scribed below. 

o Project Coordinator with the advice of the Management Sup- 
port Contractor and the Evaluation Contractor shall jointly 
select and/or approve three commercially available, nation- 
ally normed, standardized reading tests or subtests. 
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Within twelve school days of the Contractor’s first day of 
classes, Evaluation Contractor shall administer the three 
tests, one test per student, to the appropriate grade levels. 
Contractor shall not be told, nor shall he attempt to de- 
termine in any manner whatsoever what test or what form of 
what test any student received. Contractor shall be in- 
formed by the Evaluation Contractor five days prior to the 
pre-test of the level of the test to be used for each grade 
level involved in the project. Contractor shall be informed 
by the Evaluation Contractor of each student’s pre-test 
grade level score within 16 school days of the administra- 
tion of the tests in each district. 

No sooner than 12 days prior to the Contractor’s last day 
of classes, Evaluation Contractor or designee shall admin- 
ister the post-test to each student. The post-test shall 
be a different form of the same test that was administered 
to the student as the pre-test. LEA will certify the con- 
ditions of the testing in writing in a format to be supplied 
by the Management Support Group as approved by the Evalua- 
tion Contractor. In the event that the parties hereto, 
along with the Evaluation Contractor, mutually agree that 
the conditions of testing for payment purposes, administered 
by the Evaluation Contractor, are not reasonably satisfac- 
tory nor comparable, a re-test will be administered. 

Prior to the post-testing, the Contractor shall be told, 

nor shall he attempt to determine in any manner whatsoever, 
what test or what form of what test any student shall re- 
ceive. Entry and exit level of each student participant 
will be determined by pre- and post-test scores on any one 
of three nationally nortned, standardized* commercially 
available achievement tests administered at the beginning 
and end of the project by the Evaluation Contractor which 
shall supervise these and all other evaluation tests. Such 
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tests will be the basis for determining student achievement 
gains and Contractor reimbursement as provided herein. No 
information whatsoever shall in any way be disclosed to 
Contractor as to what test or forms of the test have been 
or will be used. 

The Evaluation Contractor shall administer and/or supervise 

the interim assessment tests. 

o The Contractor shall submit no later than November 23, 1970 
to the Evaluation Contractor the test items it proposes to 
use for each Interim Test, //I through // 4. Contractor shall 
indicate the objectives to be assessed and the relationship 
of the objectives to the Contractor’s curriculum. The Con- 
tractor shall submit no fewer than three test items for 
each objective. 

o The Evaluation Contractor shall certify to the Project Co- 
ordinator that the objectives to be assessed are a fair 
measure of the Contractor’s Pregram and the achievement 
potential of the students. 

o If the above requirements are not met to the satisfaction 
of the Evaluation Contractor, he shall make recommendations 
for improvement in writing to the Project Coordinator and 
the Contractor. 

o The Project Coordinator with the assistance of the Project 
Director shall suggest to the Contractor a remedy to the 
conditions complained of. Within two working days the Con- 
tractor will notify the Project Coordinator of corrective 
action taken, if any. The Project Coordinator shall have 
five working days within which to approve or reject the 
corrective action, if any. 

o At the conclusion of the period of ten working days from 
date of first notice to the Contractor, the Project Co- 
ordinator must either certify that the pool of interim 
performance objectives is approved or that he rejects the 
corrective action. If the Project Coordinator fails to 
take any action, then certification of the pool of interim 
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performance objectives shall be deemed to be made effective 
as of the tenth working day after notice and Payment shall 
be made in accordance with paragraph 4.05. 
o If the Project Coordinator and the Contractor fail to reach 
agreement with regard to any of the above, then the appeal 
proceduies set forth in paragraph 7.01 shall apply, except 
thac the LEA will select th± party jointly with the Evalua- 
tion Contractor. 

3.03 o The test question item pool procedures and the use of a 
variety of standardized fet'.ts is intended to prevent af- 
firmative influencing o; student performance on standard- 
ized, norm reference ti-sts by foreknowledge of questions 
to be asked, common'? called "teaching to tests." Suspi- 
cion that such a r -rent has been attempted or accomplished 
shall be state- 1 , in writing by any parties to this contract 
and project to the Project Coordinator and communicated to 
the Management Support Groua- Project Coordinator and mem- 
bers of the Title I staff of the SEA or its designees shall 
visit the project site and determine the validity of the 
charge, the number of participants affected, and whether 
any damage was caused. The Project Coordinator shall then 
make findings and recommendations to the Project Director 
and the Contractor. The Contractor has the right to object 
to any of the findings reached by the Project Coordinator, 
o If the parties fail to reach agreement the appeal procedure 
shall apply and the project shall continue pending final 
determination of the appeal . 

o The Project Director shall have the authority to termina j 
the project for cause at that point and to require the Con- 
tractor to return all funds paid him by the LEA. 

4.01 The total amount to be paid to the Contractor shall be based 
on the performance of each of the students enrolled in the 
Program. The performance of each of the students is based 
on both interim performance tests as defined herein and upon 
a pre- and post-test as defined herein. The pre-test 
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aforementioned shall be administered within twelve days of the 
beginning of the program and the post-test shall be adminis- 
tered withir twelve days of the completion of the Program. 

4.02 Payment on Basis of Standardized Test Results. 

o The average maximum unit final payment the Contractor shall 
re eive for student achievement measured by pre- and post- 
test scores on national standardized tests shall not exceed 
$63.75 per student, or a total amount based on pre— and post- 
test results for all students on standardized tests not to 
exceed $15,937.50 for 250 students, 
o Determination and calculation of payment shall be made on 
the basis of a pre- and post-test as defined herein: 

$63.75 per student enrolled in the Program for the full 
term of instruction who achieves a reading grade level 
increase of 1.7 grade level gain as reported by the 
standardized tests to be utilized under the terms of 
this contract • 

o In the event that a student exceeds the grade levex gain of 
1.7, the Contractor shall be credited in the determination 
and calculation of payment with the sum of $4.00 for each 
0.1 grade level gain above 1.7 as reported by the standard- 
ized tests to be utilized. 

o In the event that a student does not exceed the grade level 
gain of 1.7, the Contractor shall have deducted in the de- 
termination and calculation of payment the sum of $4.00 for 
each 0.1 grade level below the 1.7 gain, 
o In the event that a student leaves the Program prior to com- 
pleting the Program, and has no post-test score, the calcu- 
lation for payment will be determined as follows: 

The amount paid to the Contractor for the average stu- 
dent achievement in the same grade level, multiplied 
by the ratio of the number of completed instructional 
periods by the student who leaves, to the total number 
of periods actually provided to the grade level of the 
withdrawing student, through the entire term of in- 
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o In the event that a student leaves the Program after at least 
thirty periods of instruction and is pre- and post-tested, 
the Contractor will be paid an amount equal to the projected 
gain that the student would have achieved had he completed 
the Program prorated on the basis of the actual number of 
periods spent in the Program. 

o Determination and calculation of payment with regard to stu- 
dents who have I.Q.’s of 74 or below, as determined by any 
standard or acceptable test to the Evaluation Contractor, 
administered by the LEA or its duly authorized designee, 
shall be based on the determination and calculation of pay- 
ment set forth in the foregoing paragraphs. However, the 
grade level gain set forth in those paragraphs is changed 
for the purposes of this paragraph from a grade level gain 
of 1.7 to a grade level gain of 0.4. 

4.03 Payment Based on Interim Performance Tests. 

o The Contractor agrees to accept credit for payment on th^ 
basis of the success or failure of each student’s perfor- 
mance on a battery of objectives approved by the Project 
Coordinator, in consultation with the Evaluation Contractor, 
and selected individually for each pupil based on his diag- 
nosis. The total payment for performance on interim per- 
formance tests for all of the 250 students involved in this 
project shall not exceed $5,312.50. 

With regard to the interim tests, the following is the basis 
of calculation of the amount to be paid to the Contractor 
herein . 

o After a student correctly answers 85% of the test items on 
each interim objective prescribed by the Contractor and ap- 
proved by the Evaluation Contractor as stated herein, the 
Contractor shall be credited in the determination and cal- 
culation of final payment the sum of $21.25. 
o In the event that a student answers correctly more than 85% 
of the test items on the interim objectives in excess of 
those originally prescribed and approved, then the Contractor 
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shall be credited in the determination and calculation of 
payment with the sum of $2.00 for each of those interim 
objectives in excess of those originally prescribed by the 
Contractor and approved by the Evaluation Contractor, 
o In the event that a student fails to answer correctly 85% 
of the test items on the interim objectives described 
above, then there shall be deducted in the determination 
and calculation of payment to the Contractor the sum of 
$2.00 for each objective below those originally prescribed 
by the Contractor and approved by the Evaluation Contractor 
o If a student leaves the Program at any time prior to com- 
pletion of the Program and fails to complete the four in- 
terim tests, the calculation of payment shall be as follows 
The amount credited for the average student achieve- 
ment attained by students in the same grade level as 
the withdrawing student, multiplied by a ratio of the 
number of instructional periods actually attended by 
the withdrawing student to the total number of periods 
actually provided to the grade level of the withdraw- 
ing student, through the entire term of instruction. 

4.04 Within twenty days of the completion of the Program, a de- 
tailed certified statement shall be submitted to the Contrac- 
tor and the LEA by the Evaluation Contractor. The statement 
shall be supported by data reflecting the aforementioned 
calculations and determinations. The statement shall clearly 
disclose the amount, if any, to be paid to the Contractor by 
the LEA, or the amount to be paid to the LEA, if any, by the 
Contractor. Contractor reserves the right to inspect the 
test records and supporting data, including raw scores and 
documentation. Payment shr.ll be made in any event witl In 
thirty days after the statement is received by the Contractor 
or LEA. 

4.05 LEA agrees to pay the Contractor the total sum of $17,000 pay- 
able in six equal installments, each to be paid within seven 
(7) days after the LEA school board meeting immediately fol- 
lowing the occurrence of these events: 
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(a) The approval by the Evaluation Contractor of the interim 
performance objectives and the test items pertaining 
thereto submitted by the Contractor. 

(b) Determination by LEA that at least 50% of the partici- 
pating students are receiving instruction unuer the pro- 
visions of this Agreement. 

(c) Administration by the University of Virginia, School of 
Education, Bureau of Research or its designee of the 
four interim tests which shall take place within seven 
days of the following dates : 

Interim Test #1 — December 16, 1970 
Interim Test #2 — January 28, 1971 
Interim Test #3 — April 14, 1971 
Interim Test #4 — June 15, 1971 

It is understood that the aforesaid sum of $17 ,000 constitutes 
80% of the average maximum total sum which equals the total 
sum of $21,250, based on the enrollment in the Program of 250 
students . 

4.06 o If the LEA does not provide the stipulated number of stu- 

dents (250) within ten school days after the Contractor's 
Program Is operational, the Contractor shall be credited 
with the sum of $85.00 in the determination and calculation 
of payment per student vacancy. If LEA provides a replace- 
ment in the Program after the ten day period, the credit 
of $85.00 will be prorated in accord with paragraph 4.02 
and 4.03. 

o In the event a replacement student enters the Program, the 
basis for determination and calculation of payment shall 
be the same as in paragraph 4.02 and 4.03 for the pre- and 
post-test scores and for the interim tests. 

4.07 In the event that 150 days of instruction are not available 

for Program operation due to: (a) insufficient number of 

school days remaining in the regular school year; (b) testing 
time required by the Evaluation Contractor; or (c) any event 
beyond the control of the LEA which precludes the 7A from 
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making students or Program facilities available to the Con- 
tractor, the procedure for determining and calculating credit 
for payment will be as follows: 

The grade level gains specified in paragraph 4.02 of 1.7 
or 0.4 grade level gains will be multiplied by a ratio of 
the number of days between the opening date of the Program 
and the date of the regularly scheduled post-tef.t less any 
other days subtracted due to conditions "a”, , and ,, c tl 

described above to 150 days. The grade level gain obtained 
and described in tnis paragraph shall be substituted in 
paragraph 4.02 for the grade level gain 1.7 or 0.4 contained 
therein and the determination and calculation of payment 
shall be made as provided for in paragraph 4.02. The open- 
ing date of the Program Wj.11 not be later than November 4, 
1970. 

5.01 Contractor certifies that the instructional system, materials, 
and equipment to be used in the project are the same as, or 
do substantially duplicate, those listed or otherwise identi- 
fied in its response dated August 13, 1970 to the RFP dated 
July 13, 1970. 

5.02 If, during contract period. Contractor wishes to change the 
instructional system, materials, equipment used, or personnel 
requirements, it must notify Project Coordinator of any sub- 
stantial changes and seek approval in accordance with proce- 
dures prescribed by the Project Coordinator, the Management 
Support Group, and LEA. 

5.03 The IE A understands that it may purchase from the Contractor 
new materials and equipment of the type used in the Program. 

On its part, the Contractor agrees that it will offer such 
materials and equipment at a price no greater than offered 
to its most favored customer. The Contractor hereby grants 
to LEA the option to purchase all or part of the equipment, 
materials, and furnishings used by the Contractor in the Pro- 
gram for the amount set forth in the Contractor’s Proposal 
dated August 13, 1970, less 30% depreciation of actual purchase 
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cost. The LEA must exercise the aforesaid option no later 
than July 15, 1971. Notice of the exercise of the option 
must be given in writing, addressed to the Contractor at 
1501 Broadway, New York, N.Y. 10036. Such writing shall con- 
tain a statement by the LEA as to the equipment, materials, 
and furnishings it wishes to purchase from the Contractor. 

In the event that the LEA does not choose to exercise the op- 
tion, the Contractor shall have up to and including August 
15, 1971 to remove its property from the premises of the LEA. 

5.04 The Contractor guarantees that the Program used during the 
1970 -71 school year will achieve at least 50% of the cost- 
effect; veness (as hereinafter defined) durin°- the school year 
1971-72 upon the following conditions: 

(a) that the Contractor, where necessary, provides additional 
training, controls materials used, supervises and moni- 
tors the Program, and 

(b) that the LEA pays for materials and services set forth 
above . 

As used in this paragraph, cost-effectiveness is defined to 
mean the average per student gain achieved during the school 
year 1970-71 based on the same achievement tests used during 
the 1970-71 school year at the same per student cost (student 
cost is an amount based on the number of students enrolled 
divided by the actual costs of the Contractor) as during the 
school year 1970-71. 

6.01 All terms, conditions, and provisions hereof shall inure to 
and shall bind the parties hereto and for each of their suc- 
cessors and assigns. Contractor shall not assign or transfer 
its interest, responsibility, or claims payable under this 
contract without prior written consent of the LEA. 

6.02 The Contractor agrees within five days of the effective date 
of this contract to secure the repayment of any money received 
by the Contractor under this contract, in the event the Con- 
tractor does not perform in accordance with the conditions 
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of the contract. Such security must be acceptable to the 
LEA. 

LEA may terminate this contract when it concludes that such 
termination is in the best interest of the LEA. In such 
event, the LEA shall bear no liability for costs the Contrac- 
tor incurred related to this project after notice of termina- 
tion. Notice shall be given to Contractor by means of a reg- 
istered letter mailed to the Contractor at its office at 1501 
Broadway, New York. In the event of such termination before 
Contractor has offered fifty days of instruction, or in any 
event if 80% or more of the students cannot be post-tested. 
Contractor shall be reimbursed based on audited costs in- 
curred, including direct overhead and general and administra- 
tive costs up to receipt of notice of termination plus an 
additional charge of ten percent of the actual costs of the 
Contractor. In no event will the total cost reimbursement 
to the Contractor be greater than the total maximum amount 
stated in paragraph 4.02 and 4.03. 

o For the purpose of this contract Direct Costs shall be de- 
fined as the expenses incurred and payments made by the 
Contractor as a result of work, labor and services performed 
and furniture, fixtures and materials purchased or provided 
exclusively under the terms of this contract, 
o Overhead Costs are herein defined as expenses incurred or 
payments made which are not directly identifiable with the 
performance of the contract and may consist of but shall 
not be limited to the following: bookkeeping, payroll, 

billing, central office evaluation of the project, 
o General and Administrative Costs are defined as the costs 
of overall management of the corporation, 
o In the event that the statement of audited costs submitted 
by the Contractor is unacceptable to the LEA, then the SEA 
Title I ESEA auditor will perform an audit whose findings 
will be binding. 

o If after fifty periods of instruction by Contractor more 
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than 80% of the students can be post-tested. Contractor shall 
be reimbursed on the basis of pre-test, post-test net gain 
scores as described in paragraph 4.02 and on the basis of 
interim tests as described in paragraph 4.03. 

7.01 Except as otherwise provided, any dispute arising under this 
contract shall be decided by the Project Coordinator who shall 
reduce his decision in writing and mail or otherwise furnish 

a copy to each of the parties hereto. Within ten days of the 
receipt of such decision the Contractor or the LEA may serve 
on the other and the Project Coordinator a notice of appeal. 
Within five days thereafter each of the partied hereto, with 
the exception provided for in paragraph 3.02 shall select one 
person who in turn shall agree on a third person who together 
with the persons selected by the parties hereto shall hear 
and determine the appeal, a decision of the majority being 
final. If the persons selected fail to agree on a third per- 
son the parties hereto shall continue to select individuals 
until the persons selected are able to agree on a third person. 

7.02 The Contractor within 15 days of the effective date of this 
contract shall apply in an appropriate manner to the Common- 
wealth of Virginia to qualify under the laws of the Common- 
wealth to do business in the Commonwealth of Virginia. 



74 



IN WITNESS WHEREOF the parties have signed this Agreement the da> , 
month and year first above written. 



Norfolk Public Schools 
Commonwealth of Virginia 



Mr. Paul H. Smith 

Assistant Superintendent of Finance 
Agent — Norfolk City School Board 



Learning Research Associates, Inc. 



Concurrence 

Authorized Official 



University of Virginia 
Bureau of Research 
School of Education 



By. 



President 



AMENDMENT AND MODIFICATION OF AGREEMENT BETWEEN LEARNING RESEARCH AS- 
SOCIATES , INC. AND 

DATED : ^ 



Section 4.02 is hereby amended by adding thereto the following: 
"Notwithstanding anything contained herein, any first grade stu- 
dent who is not pre-tested and whose I.Q. is 75 or above must achieve 
on the post-test a grade equivalent of 2.0. For each child reaching 
the aforesaid grade level, payment in the amount of $63.75 per student 
enrolled in the program for the full term of instruction shall be made 
to the Contractor. 

In the event the aforesaid student exceeds the grade equivalent 
of 2.0 the Contractor shall be credited in the determination and cal- 
culation of payment in the sum of $4.00 for each 0.1 grade level gain 
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above the grade equivalent of 2.0 as reported by the standardized tests 
to be used. 

In the event that such a student does not achieve a grade level 
equivalent of 2.0 the Contractor shall ha^e deducted in Lhe determina- 
tion and calculation of payment the sum of $4.09 for each 0.1 grade 
level below the grade equivalent of 2.0. 

Notwithstanding anything contained herein, any first grade student 
who is not pre-tested and whose I.Q. is 74 or below must achieve on the 
post-test a grade equivalent of 1.4. For each child reaching the afore- 
said grade level, payment in the amount of $63.75 per student enrolled 
in the program for the full term of instruction shall be made to the 
Contractor . 

In the event the aforesaid student exceeds the grade equivalent of 
1.4 the Contractor shall be credited in the determination and calcula- 
tion of payment in the sum of $4.00 for each 0.1 grade level gain above 
the grade equivalent of 1.4 as reported by the standardized tests to be 
used . 

In the event that such a student does not achieve a grade level 
equivalent of 1.4 the Contractor shall have deducted in the determina- 
tion and calculation of payment the. sum of $4.00 for each 0.1 grade 
level below the grade equivalent of 1.4- 

Students enrolled in grades 2 and 3 who do not answer any item in 
the pre-test correctly shall have assigned to them the lowest grade 
equivalent provided for in the test administered. 

With the exception of the students described in the seven (7) para- 
graphs immediately preceding thi.- paragraph there shall be no re-pre- 
testing of the students . Enrolled students who were not tested during 
the pre-test administration shall be deemed to have a score on the 
standardized achievement test which he would have taken which will be 
equal to the mean score of those nre-tested students enrolled in the 
program and on the same grade level and in the same school as those 
students who are not pre-tested." 

Section 2.03 is hereby amended by adding thereto the following: 
"Replacement students in the program shall be tested within seven 
(7) school days from the date of notification of enrollment in the pro- 
gram given to the Evaluation Contractor." 
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Section 4,C3 shall be modified by deleting in paragraphs 2, 3 and 
4 thereof "85%" and substituting "80%" wherever it appears in the afore- 
said paragraphs . 

Section 3.02 shall be amended by adding thereto the following: 

"The center teachers will certify mastery of each performance ob- 
jective by the student. The date of mastery will be noted on the back 
of the record form. The Evaluation Contractor may periodically and 
without announcement , test a sample of students in each center to deter- 
mine and verify that a student has successfully achieved the objective 
certified by the center teacher. For this purpose the Evaluation Con- 
tractor will use the test items given to it by the Contractor, The 
Evaluation Contractor will test those objectives achieved by the stu- 
dent within the three-week period immediately preceding the date of : ; ;:ich 
test. Certain performance objectives will be verified by tne Evaluation 
Contractor conducting interviews of the students. 

A record of each student* s achievement on the interim performance 
objective shall be kept by the Evaluation Contractor which record shall 
be signed and certified by an appropriate designee. The record will be 
available for inspection by the Contractor.** 

Section 4,05 is hereby amended by adding thereto, following the 
first sentence of the section which ends with the words **of these 
events*', the words "and these dates". 

Section 4.05 is further amended by deleting paragraph (c) thereof 
ending with the words "Interim Test #4** and substituting therefor the 
following dates: "December 18, 1970; February 5, 1971; April 2, 1971; 

and May 28, 1971," 



Norfolk Public Schools 
Commonwealth of Virginia 



By /s/ 

P. H. Smith 
Authorized Official 



Learning Research Associates 



By Is/ 

Lee Do Brown 
President 



Concurrence 



As/ 

Charles A. Woodbury, Jr 
Authorized Official 



University of Virginia 
Bureau of Research 
School of Education 




71 



TEXARKANA-DORSETT CONTRACT, 1969 



SUBCONTRACT BETWEEN THE LEA FOR THE 
TEXARKANA DROPOUT PREVENTION PROGRAM AND 
DORSETT EDUCATIONAL SYSTEMS, INC. 



Purpose 

This subcontract is based upon the RFP dated 6-10-69, issued by the LEA, 
the proposal submitted by Dorsett, and a mutually agreed upon Letter of 
Intent. It is intended to stipulate the scope of work, responsibilities, 
and obligations assumed by both parties, but to the extent that further 
details are required to interpret matters arising under it the above 
documents are incorporated by reference. 

I . Period of Contractual Obligation 

The period of contractual obligation begins September 10, 1969 and ex- 
tends until June 5, 1970. 

II . Previous Obligation 

The grant terms and conditions of grant // 0EG-0-9-130045-3360 Project 
# 13-0045 between LEA, Texarkana, Arkansas School District # 7 and the 
U.S. Office of Education are incorporated herein by reference and made 
a part of this contract. 

Ill • General Scope of Work Assumed by Dorsett 
Dorsett agrees: 

a. to organize and operate the instructional component of the first 
phase of the Texarkana Dropout Prevention Program. 

b. to provide instruction in basic reading, math and study skills to a 
minimum of 200 students. The study skills may be measured by inference 
of the achievement in math and reading areas,, 

c. to hire and train local personnel, if possible these people will 
come from the target area, as para-professionals in the operation of the 




instructional program. 

d, to utilize at least 20 teachers and administrators from the partic- 
ipating school systems who will work part-time in the instructional pro- 
gram and will facilitate the contemplated transfer of the Dorsett mate- 
rial to the Texarkana Rapid Learning Centers. Their firsthand knowledge 
of the nature and extent of academic problems unique to the Texarkana 
schools will be useful to the contractor. 

e. to operate centers at locations mutually agreeable to the parties. 

IV. Selection of Students 

a. All students who participate in this instructional program will 
have grade level deficiencies# in reading and math# of 2.0 or more as 
determined by the Iowa Test of Basic Skills or the SRA Tests. Further# 
all of these students will have no less than the minimum Intelligence 
Quotient# as determined by Lorge Thorndike and SRA Ability Quotient, of 
a regularly enrolled student as required by the two school districts, 
seventy in Texas and seventy-five in Arkansas, by the Project Management 
Office or its delegated representative. 

b. All students who participate in the first phase of this instructional 
program will come from grades 7-12 in the regular school system. 

c. The makeup of the first 200 students will consist of approximately 
equal numbers of volunteers, students assigned by counselors, and stu- 
dents randomly selected from those with a grade level deficiency of 2.0 
or more. 

d. The makeup of any group of students beyond the initial 200 will be 
similar to that of the first 200, or will have characteristics determined 
by the LEA and stipulated by the reference material. (RFP , Dorsett f s 
proposal# and the Letter of Intent.) 

V. Testing 

a. The entry status for each student will be determined by the most 
recent test. The Texarkana# Arkansas school system used ITBS Form 3 
and the Liberty Eylau school district used SRA Achievement Series Form 
D. These tests were given the first week of October, 1969. In all 
cases the tests were given on a group basis and the counselors in the 
individual schools administered the tests. The same conditions will 
exist for the post- test as was the case in the pre-test. 

b. The parties agree that Dorsett will have the option to ask for re- 
testing or adjustment to entry level standing determined by pre-tests 
where its diagnostic test shows a substantial difference and that the 
pre-test may have been insensitive to the actual grade level deficiency 
when the deficiency is 2.0 grade levels or more. Diagnostic tests given 
by Dorsett should be administered under conditions similar to that of 
the initial pre-test. Further, Dorsett will notify the LEA as to what 
diagnostic test will be used and will allow observation of the testing 
by the Project Manager or the Internal Evaluator. The negotiation of 
the interpretation of these tests will be handled by Dorsett 1 s repre- 
sentative and the Project Manager with the help of the Internal Evalu- 
ator, Final determination of whether re-test will be given will rest 
with the Project Manager. 



c. Exit level achievement will be determined by the IT3S or SRA tests 
administered by a delegate of the LEA. 

d. It is the responsibility of the LEA to report in writing the test 
results for each student to Dorsett. Results of testing conducted by 
Dorsett will be conveyed to the LEA in the form of written reports to 
be the basis for each monthly evaluation. While Dorsett may not admin- 
ister tests comparable to entry or exit, national norm tests, it will 
continually obtain progress check tests for each subject unit. The 
number of such tests successfully completed by each assignee and the 
scores will be included in the Dorsett monthly report. 

VI. Attendance of Students 

a. Withdrawal from the Dropout Prevention Program may occur under the 
following circumstances and Dorsett will be paid on the hourly basis. 

(1) Students move out of participating school districts. (2) Student 
is chronically truant as defined by locally applicable regulations. 
Regulations being that a student be present 50% of any grade marking 
period. (3) Student suffers prolonged period of illness. Same regula- 
tions as truancy. (4) Student is removed from program on the mutual 
agreement of the LEA and Dorsett. A student will be considered a legit- 
imate withdrawal if he enrolls in the program, participates for a mini- 
mum of ten hours of instruction, and withdraws from the program for any 
of the above reasons. If the student is in the RLC for less than ten 
hours, no payment will be made to Dorsett. 

b. In the event that a student withdraws from the program, the LEA 
will, whenever possible or practical, fill the empty slot with another 
student, no later than 30 days before the termination of the grant 
(June 5, 1970). Low academic performance will not be considered an 
adequate reason for withdrawal from the program until the parties to 
this contract mutually agree. 

VII . Cost of Mobile Facilities and Refurbishing 

a. Dorsett will assume the cost of providing one mobile facility during 
Phase I of this project to be used as an instructional center at the Tex- 
arkana Arkansas High School. Two of the four or more Rapid Learning Cen- 
ters operated by Dorsett are to be refurbished rooms in existing schools. 
Two or more of the Rapid Learning Centers may be operated in mobile class- 
rooms provided by Dorsett and for which a monthly rental allowance of 
$95.00 per mobile classroom will be paid by the project. At any time 
during the contract period the LEA may purchase these mobile classrooms 
at Dorsett 1 s actual cost less accumulated rental payments. 

VIII . Method of Cost Reimbursement 



a. In consideration for services rendered, Donett will be compensated 
on the basis of actual student successful performance, not to exceed 
$135,000.00 in total and subject to reduction on failure to obtain 
achievements or performance. 

b. The student performance differential is determined by subtracting 
the entering grade level achievement in math and reading from the exit 



level. Entry status and exit status are based on the SRA and ITBS tests 
as weighted on a basis to be determined no later than February 1, 1970. 
This procedure will be applied to all assignees except withdrawals, and 
a small number of students, assigned by nonrandom procedures, to be mu- 
tually agreed by the parties to this contract, for whose learning ser- 
vices Dorsett will be reimbursed at the average hourly rate of other 
students . 

c. Dorsett will be compensated on the basis of obtaining one grade 
level increase per subject area in eighty hours of instructional renter 
study for $80.00, or proportionally for each fraction thereof. For 
students requiring more or less than 80 hours per subject grade level 
increase, the payment to Dorsett per subject grade level increase will 
vary according to the formula $80.00 x 80 hours divided by actual study 
hours required per subject grade level increase. According to this 
formula, one grade level increase per subject area in 110 hours of in- 
struction would cost $58.18. Both parties agree that $106.67 for 60 
hours represents the upper limit of the cost reimbursement formula and 
that if over 110 hours of instruction are required, the payment for a 
grade level increase will be reduced by $1.00 per hour for every hour 
over 110. This payment schedule will result in no payment to the con- 
tractor if 168 or more hours are required for one grade level achieve- 
ment. 

d. Monthly progress payments may be made to Dorsett for reimbursement 
of not more than an estimated 85% of direct and indirect costs incurred 
by Dorsett for its operations, provided further that the payments do not 
exceed the estimated accruals to Dorsett for grade level gains, based 

on sampling tests or progress check tests, in the professional judgment 
of the Project Director. It is noted that repeated testing with the 
same or similar test instruments used for final audit on student disas- 
signment would contaminate the validity of results, so different tests 
must be used for interim evaluation. 

IX. Availability and Cost of Capital Equipment 

a. Dorsett agrees to sell 95 units of the Dorsett M86 Teaching Ma- 
chines at a unit price of $200.00 for a total of $19,000.00. All equip- 
ment will carry standard warranty. In the event that the contractor 
fails to achieve substantial gains in the program Dorsett will repur- 
chase the equipment at full price. 

b. During the period of this contract, Dorsett is responsible for the 
full maintenance and upkeep of the Dorsett manufactured equipment. In 
accordance to the standard one year warranty, repairs wilj. be made on a 
24 hours basis or another M86 machine will take its place. An adequate 
amount of supplies and parts for the M86 will be available. The train- 
ing of local personnel for maintenance of the M86 will also be part of 
the program. 

X. Use of Consultants Listed in the Dorsett Proposal 

It is understood that all key consultants or persons of similar status 
and staff members listed in the Contractor Proposal will be used on a 
working level, including site visits. Deletion or addition of consul- 



tants must be mutually agreed upon by both parties. The LEA must be 
satisfied as to the active participation of those consultants used by 
the Contractor. Dr. James L. Evans will be an active and frequent 
contributor to this program. 

XI * Availability of Instructional Materials 

a. Materials to be used in this instructional program will substan- 
tially duplicate that listed in the Dorsett Proposal. 

b. Dorsett will provide materials for medium and high achieving stu- 
dents and will have such material available at the instructional cen- 
ters for testing with a sample population no later than April 30, 1970. 

XII . Community and Public Relations 

a. The LEA is responsible for informing parents, instructional center 
employees, and students about testing procedures, scheduling, dismissal 
and progress reports. 

b . All official press releases concerning this program should origi- 
nate from LEA. 

XIII. Review of Contract 

The parties agree that from time to time the LEA may review progress 
on the program and ask for contract amendments if reasonably anti 'i— 
pated progress is not being obtained. 

XIV. Applicable Statutes 

In case of conflict arising under this contract the laws of the State 
of Arkansas will prevail. Unless otherwise stipulated, parties will 
be bound by the request for proposal and the proposal of the Contractor 

XV. Officials Not to Benefit 



No member of or delegate to Congress, or resident commissioner, shall 
be admitted to any share or part of this contract, or to any benefit 
that may arise therefrom; but this provision shall not be construed to 
extend to this contract if made with a corporation for its general 
benefit . 

XVI . Covenant Against Contingent Fees 

The Contractor warrants that no person or selling agency has been em- 
ployed or retained to solicit or secure this contract upon an agreement 
or understanding for a commission, percentage, brokerage, or contingent 
fee, excepting bona fide employees or bona fide established commercial 
or selling agencies maintained by the Contractor for the purpose of se- 
curing business. For breach or violation of this warranty the Fiscal 
Agent shall have the right to annul this contract without liability or 
in its discretion to deduct from the contract priie or consideration, 
or otherwise recover, the full amount of such commission, percentage, 



brokerage, or contingent fee. 



XVII. Equal Employment Opportunity 

(Section 202, Executive Order 11246, September 24, 1965, 30 FR 11269) 
"During the performance of this contract, the Contractor agrees as 
follows : " 

"(1) The contractor will not discriminate against any employee 
or applicant for employment because of race, creed, color, or national 
origin. The contractor will take affirmative action to ensure that 
applicants are employed, and that employees are treated during employ- 
ment, without regard to their race, creed, color, or national origin. 
Such action shall include, but not be limited to the following: em- 

ployment, upgrading, demotion, or transfer; recruitment advertising; 
layoff or termination; rates of pay cr other forms of compensation; 
and selection for training, including apprenticeship. The contractor 
agrees to post in conspicuous places , available to employees and appli- 
cants to* employment, notices to be provided by the contracting officer 
setting forth the provisions of this nondiscrimination clause. 

"(2) The contractor will, in all solicitations or advertisements 
for employees placed by or on behalf of the contractor, state that all 
qualified applicants will receive consideration for employment without 
regard to race, creed, color, or national origin. 

"(3) The contractor will send to each labor union or representa- 
tive of workers with which he has a collective bargaining agreement or 
other contract or understanding, a notice, to be provided by the agency 
contracting officer advising the labor union or workers 1 representative 
of the contractor's commitments under Section 202 of Executive Order 
No. 11246 of September 24, 1965, and shall post copies of the notice 
in conspicuous places available to employees and applicants for employ- 
ment . 



"(4) The contractor will comply with all provisions of Executive 
Order No. 11246 of September 24, 1965, and of the rules, regulations, 
and relevant orders of the Secretary of Labor. 

'*(5) The contractor will furnish all information and reports re- 
quired by Executive Order No. 11246 of September 24, 1965, and by the 
rules, regulations, and orders of the Secretary of Labor, or pursuant 
thereto, and will permit access to his books, records, and accounts by 
the contracting agency and the Secretary of Labor for purposes of in- 
vestigation to ascertain compliance with such rules, regulations and 
orders . 

11 (6) In the event of the contractor's noncompliance with the non- 
discrimination clauses of this contract or with any of such rules, reg- 
ulations, or orders, this contract may be cancelled, terminated or sus- 
pended in whole or in part and the contractor may be declared ineligible 
for further government contracts in accordance with procedures author- 



ized in Executive Order No. 11246 of September 24, 1965 and such other 
sanctions may be imposed and remedies invoked as provided in Executive 
Order No. 11246 of September 24, 1965, or by rule, regulation, or order 
of the Secretary of Labor, or as otherwise provided by law. 

"(7) The contractor will include the provisions of Paragraphs (1) 
through (7) in every subcontract or purchase order unless exempted by 
rules, regulations, or orders of the Secretary of Labor issued pursuant 
to Section 204 of Executive Order No. 11246 of September 24, 1965, so 
that such provisions will be binding upon each subcontract or vendor. 

The contractor will take such action with respect to any subcontract 
or purchase order as the contracting agency may direct as a means of 
enforcing such provisions including sanctions for noncompliance: Pro- 

vided , however , that in the aveiit the contractor becomes involved in, 
or is threatened with, litigation with a subcontractor or vendor as a 
result of such direction by the contracting agency, the contractor 
may request the United States to enter into such litigation to protect 
the interest of the United States." 

XVI II . Certification of Non-Segregated Facilities 

The contractor or subcontractor certifies that he does not maintain or 
provide for his employees any segregated facilities at any of his estab- 
lishments, and that he does not permit his employees to perform their 
services at any location, under his control, where segregated facili- 
ties are maintained. He certifies further that he will not maintain 
or provide for his employees any segregated facilities at any of his 
establishments, and that he will not permit his employees to perform 
their services at any location under his control, where segregated 
facilities are maintained. The contractor or subcontractor agrees that 
a breach of this certification is a violation of the Equal Opportunity 
Clause in this contract. As used in this certification, the term 
"segregated facilities" means any waiting rooms, work areas, rest rooms 
and wash rooms, restaurants and other eating areas, time clocks, locker 
rooms and other storage or dressing areas, parking lots, drinking foun- 
tains, recreation or entertainment areas, transportation, and housing 
facilities provided for employees which are segregated by explicit di- 
rective or are in fact segregated on the basis of race, creed, color, 
or national origin, because of habit, local custom, or otherwise. He 
further agrees that (except where he has obtained identical certifica- 
tions from proposed subcontractors for specific time periods) he will 
obtain identical certifications from proposed subcontractors prior to 
the award of subcontracts exceeding $10,000.00 which are not exempt 
from the provisions of the Equal Opportunity Clause; that he will re- 
tain such certifications in his files; and that he will forward the 
following notice to such proposed subcontractors (except where the pro- 
posed subcontractors have submitted identical certifications for spe- 
cific time periods) : 

XIX. Notice to Prospective Subcontractors of Requirement for Certifi- 
cations of Nonsegregated Facilities 

A Certification of Non-Segregated Facilites, as required by the May 9, 
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1967, order (32 F.R. 7439, May 19, 1967) on Elimination of Segregated 
Facilities, by the Secretary of Labor, must be submitted prior to the 
award of a subcontract exceeding $10,000.00 which is not exempt from 
the provisions of the Equal Opportunity Clause. The certification 
may be submitted either for each subcontract or for all subcontracts 
during a period (i.e., quarterly, semiannually, or annually). 

Note: The penalty for making false statements in offers is prescribed 

in 18 U.S.C. 1001. 



Edward D. Trice, Fiscal Agent 



Loyd Dorsett, President 
Dorsett Educational Systems, Inc. 
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TEXARKA N A-EDL CONTRACT, 1970 



CONTRACT 
BETWEEN THE 

TEXARKANA SCHOOL .DISTRICT # 7 



and 

ECUCATI ONAL DEVELOPMENTAL LABORATORIES, INC. 
A DIVISION OF McGRAW-HILL 



THIS CONTRACT, made and entered into this 18th day of September, 
1970, by and between the Texarkana School District #7, a public school 
District organized and existing under the laws of the State cf Arkan- 
sas, with principal offices located at 1500 Jefferson Avenue, Texarkana, 
Arkansas 75501 (hereinafter called LEA) , and the JOINT VENTURE comprised 
of EDUCATIONAL DEVELOPMENTAL LABORATORIES, INC., a Division of McGraw- 
Hill, a private corporation organized and existing under the laws of 
the State of New York with principal offices located in Huntington, New 
York, (hereinafter referred to as the Contractor), and Arkansas School 
Service, Inc., a private corporation (a franchised dealer of EDL/McGraw- 
Hill) organized and existing under' the laws of the State of Arkansas 
with principal offices located at 1911 Thayer Street, P.0. Box 2901, 
Little Rock, Arkansas 72203, and Texas Educational Aids, a private cor- 
poration (a franchised dealer of EDL/McGraw-Hill) organized and exist- 
ing under the laws of the State of Texas with principal offices located 
at 120 East Elm, Tyler, Texas 75701. This contract is based upon the 
Texarkana School District #7, Arkansas, RPP #2 and the continuation 
proposal financed by U.S. Office of Education administered ESEA Title 
VIII grant number 0E0-0-9-130045-3300281) , the Proposal submitted by 
EDL August 13, 1970, and Addendum September 15, 1970, and documented 
negotiated details September 24, 1970, and is incorporated by reference 
and made part, hereof. 

It is intended to stipulate the scope of work, responsibilities, 
and obligations assumed by both parties . If further details are re- 
quired to interpret matters arising under it, the above documents and 



all controlling local state, and federal laws and regulations and their 
issues are incorporated in this contract by reference. In instances 
of conflicts within and between said incorporated documents, resolution 
will follow, in descending order of authority: (1) Federal laws, reg- 

ulations, and their issues; (2) State laws, regulations, and their is- 
sues; (3) Local laws, regulations, and their issues and (4) Mutual con- 
venience of the contractual parties. 

Performance under this contract shall commence September 28, 1970 
and terminate June 30, 1971. 

OPTION TO RENEW 

A. By April 1, 1971 the Contractor will submit in six copies a de- 
tailed statement of work planned to be accomplished during the 
next program year and six copies of a detailed P.P.B.S. budget 
to support this plan. 

B. The LEA will provide written notice to the Contractor by June 
21, 1971, based on the meeting and agreement reached by the 
combined school boards at their June 15, 1971, meeting of their 
option to review the program for the subsequent year. 

I. SCOPE OF WORK 

The long-range goals of the Texarkana Dropout Prevention Pro- 
gram are: 

1. To significantly reduce the percentage of dropouts in the 
Texarkana and Liber ty-Eylau school districts . 

2. To increase academic achievement and skill development of 
students who are educationally deficient. 

3. To increase the cost effectiveness of the instructional pro 
gram in the Texarkana and Liberty-Eylau school districts. 

II. DUTIES OF CONTRACTOR 

Using the existing facilities, the Contractor shall establish 
and operate a teacher support program at a minimum of one learn 
ing center located at each of the following schools: College 

Hill Junior High School; Jefferson Avenue Junior High School; 
Arkansas Senior High School; Liberty-Eylau Junior High School; 
and Liberty-Eylau Senior High School . 

III. RESPONSIBILITIES OF CONTRACTOR 

1. The Contractor agrees to provide an instructional learning 
system appropriate to the individual needs of the target 
population . 



2. Whenever appropriate, the Contractor agrees to make maximum 
use of LEA facilities and equipment resources located at 
the school sites, i.e., mobile units, furnishings, desks, 
etc . 

3. The Contractor agrees to purchase, assemble, install, and 
maintain all Contractor-owned equipment which will be uti- 
lized during the school year at his costs. 

4. The Contractor agrees to apply all rental costs to the pur- 
chase of any equipment and material on lease at the price 
quoted in the Contractor’s 1971 published catalog. The 
LEA will have the option to exercise its rights under the 
contract at any time prior to June 30, 1971, for all equip- 
ment and materials used during the 1970-1971 school year. 

The Contractor agrees to conduct program operations for 
students in the late afternoon or early evening. The addi- 
tional cost to LEA for operating these evening centers shall 
not exceed the established costs for the operation of re- 
gular learning centers for similar students. 

5. The Contractor agrees to conduct his operational program 
within the constraints of, and in accordance with, the in- 
tent and conditions of the evaluation design. 

6. The Contractor agrees to obtain the approval of the LEA in 
employing all instructional personnel used in the project. 
Whenever possible, personnel will be employed from the lo- 
cal community. 

7. The Contractor agrees to train and monitor all personnel 
employed to operate the instructional program in the learn- 
ing centers . 

8. The Contractor agrees to provide a list of performance ob- 
jectives for his instructional program in reading and mathe- 
matics. The objectives must stipulate the individual stu- 
dent achievement level required, and the cycle and level of 
instruction for which these objectives are appropriate. 

(See Section VIII, Item 2, Page 7.) 

9. The Contractor agrees to submit a student attendance record 
daily, and report to the project director at the time a stu- 
dent drops out of the program. 

10. The Contractor agrees to report the instructional system 
cost for implementation, and projections to the project 
director on April 1, 1971 as set forth in Exhibit B. 

11. The Contractor agrees to indemnify the LEA from any liabil- 
ity for damage to the Contractor-owned property. 
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12. The Contractor agrees to the responsibilities outlined in 
the proposal and addendum and RFP as identified but not 
specifically included in this contract. 

13. The Contractor agrees to instruct all personnel employed 
to operate the instructional program in the Rapid Learning 
Centers that if they are party to information relative to 
the standardized test being employed by the LEA f s internal 
evaluator to determine the guarantee performance level of 
the Contractor, the individual who has learned this infor- 
mation shall be immediately responsible for reporting such 
facts in writing to his project director. 

IV. RESPONSIBILITIES OF LEA 

1. The LEA agrees to schedule and initially provide to the Con- 

tractor no more than 300 students with an IQ of 75 or higher 
as measured by a locally administered intelligence test ful- 
filling the following entry criteria: (a) students in the 

1969-70 Rapid Learning Center (Phase I) program who did not 
gain one or more grade levels in reading comprehension or 
mathematics (b) seventh-grade students who are two or more 
grade levels deficient in reading and/or mathematics, and 
(c) students in grades 8-12 who are two or more grade levels 
deficient in reading and/or mathematics. If any question 
exists regarding the entry level of an individual student, 
the case must be referred within fifteen student class days 
in the project according to a negotiation procedure agreed 
upon by the LEA and the Contractor. Within fifteen days 
following referral of an individual, a meeting must be 
scheduled between the project director and the component 
manager at which time disposition of the individual case 
will be made . 

2. The LEA will be responsible for ensuring that any RLC stu- 
dent enrolled and in attendance for that particular day 
will attend the specific component classes operated by the 
Contractor. It will be the responsibility of the LEA to 
ensure that RLC students attend regular school classes to 
the greatest extent possible. Specific after-school pro- 
gram operating hours will be established to allow RLC stu- 
dents who have been absent to complete the work they have 
missed . 

3. The LEA agrees to make the KLC student available to the Con- 

tractor for a maximum of 140 days prior to the final post- 
test. If, in fact, fewer than 140 days of instruction are 
scheduled during the period of the project for whatever 
reason (other than fault of the Contractor) , the perfor- 
mance guarantee will be reduced proportionate to the num- 
ber of days of instruction. (Example: 120 days of in- 
struction: Guaranteed performance level would be 120/140, 

or 6/7, of the original level.) 
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4. The LEA through its internal evaluator will be responsible 
for supervising the administration and scoring of the tests; 
and continued review and analysis of all materials used by 
the Contractor in the program. 

5. The LEA agrees to schedule RLC students to the Contractor 
fo_‘ 45 to 55 minutes per day per subject matter area in 
which the student is enrolled. 

6. The LEA agrees to provide office space for Contractor's on- 
site component manager. Other operational expenses such 

as secretarial help, supplies, equipment, etc., shall be 
the responsibility of the Contractor. 

7 . The LEA agrees to appropriately maintain all space to be 
used by the Contractor in the instructional program. 

V. PERFORMANCE REQUIRED OF CONTRACTOR 

1. The Contractor guarantees that each student in the program 
will increase his achievement in reading and/or mathematics 
by 1.0 to 1.9 grade levels. 

2. The Contractor guarantees that each student will success- 
fully pass 75% of the terminal criterion-reference items. 

3. The Contractor agrees that he shall be responsible for all 
dropouts from the RLC following the initial two weeks of 
operation. The definition of a program dropout is found 
in Section VI of this contract. 

4. The Contractor shall guarantee that the operating costs of 
the proposed instructional system will decrease as a result 
of increased student enrollment, or through efficiencies 
when applied to a target population prescribed during the 
performance of this contract. 

5. The Contractor's instructional system utilized during the 
school year 1970-71 Phase II will be guaranteed to main- 
tain the cost-effectiveness level demonstrated during the 

1970- 71 Phase II school year if the LEA adopts and incor- 
porates it under the same leasing conditions into grades 
7-12 in the regular school system during the school year 

1971- 72 Phase III. This guarantee applies only if the LEA 
utilizes the Contractor’s complete program, operant under 
the same conditions as obtained throughout school year 
1970-71 Phase II. 

The Contractor agrees to train to his standards a minimum 
of ten mathematics teachers, ten English teachers, and two 
equipment maintenance persons from the participating school 
district’s personnel to operate the learning center turnkey 
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program for Phase II (1971-72) . The LEA shall select the 
teachers to be trained. The Contractor will provide in- 
formation on teacher training cost. 

7. The internal evaluator shall, during the period two weeks 
prior to the post-test, make a quality control check of 
the instructional materials in use in the program to deter- 
mine whether the Contractor nas fulfilled the requirements 
listed in Exhibit A. Should the quality control check in- 
dicate drilling of exposed items during the two-week period 
immediately prior to post-testing, the Contractor shall be 
liable for the cost of a complete comparison analysis of 
all instructional "bits 11 used in the two-week period with 
all test Items, and in addition shall be penalized $1,000.00 
for each exposed Item. 

8. The Contractor shall not include in any of his instructional 
materials any exercises that are the same as the items used 
in the tests that will be used to determine how much the 
Contractor will be paid. The definition of "same" would be 
determined by the rules in Exhibit A. These rules apply 
only to Instructional materials that have been copyrighted 
since the inception of Phase II. 

VI. METHOD OF MEASURING PERFORMANCE 

A. DEFINITIONS 

The following definitions shall apply in the program: 

1. A student will be considered a dropout from the program if 
he or she leaves school or the program and does not reenter 
within thirty days. Exceptions to this definition are: 

(a) if a student is drafted into military service (b) if a 
student is physically or mentally incapacitated to such an 
extent that he or she is not able to participate in the 
project and attend school as certified by a licensed phy- 
sician, or (c) other reasons mutually agreed upon by the 
project director and the Contractor. 

2. The starting time for each RLC student will be the first 
day the student enters the program. Any exception to this 
procedure must be agreed upon by the project director and 
the Contractor, and any such agreement must be made in writ- 
ing. 

3. The ending time for the instructional program for each stu“ 
dent shall be the date when the final standardized test is 
administered to the student . If the student takes the 
January and May 1971 standardized tests, the latter date 
shall be considered the ending date. Exiting of students 
who have demonstrated exceptional achievement will be by 




the mutual agreement of the project director and the EDL com- 
ponent manager. 

4. Actual instructional time is the net instructional time spent 
in the program. 

5. Students attending RLC T s will be referred to herein as stu- 
dent . 

VII. BASIS OF PAYMENT 

1. Determination of total payment to the Contractor will be 
based on the (a) achievement gain made by each student on 
the standardized tests, and (b) extent to which each stu- 
dent achieves the final criterion-reference measure. 

2. Seventy-five (75%) per cent of total payment will be based 
on the results of the standardized tests, and twenty-five 
(25%) per cent of total payment will be based on the re- 
sults of student achievement on final criterion-reference 
measure * 

3* Total maximum project costs of $65,788.00 are to be distri- 
buted as follows : 

Fifty (50%) per cent of the Fixed Charge, $19,506.00, 
will be paid the Contractor at the signing of the con- 
tract; and the remaining fifty (50%) per cent, $19,506.00, 
will be paid the Contractor on or before December 1, 1970. 
Final payment in the amount of $26,776.00 will be made 
to the Contractor subject to adjustment downward based 
on performance and the conditions set forth under Sec- 
tion V. Item 7, above, and Section IX, below, on or be- 
fore June 30, 19 71. 

VIII . PROCEDURES 

1. Standardized tests used to measure performance will be se- 
lected by the project director, and approved by the inter- 
nal evaluators from the nationally standardized tests gen- 
erally available to the school market. The project director 
will have authority over all pre- and post-testing condi- 
tions, and will adhere to standard testing procedures and 
scoring practices as defined by the test publisher. He 
will determine when the tests will be given, and which forms 
of the selected tests will be given to individual students. 
The Contractor will not be told what test or what forms of 
the test have been or will be used for each student. 

The Contractor must submit to the project director a pool 
of criterion-referenced test items. At least five (5) 
times the number of behavioral objectives inherent in the 
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structure of the system to be used must be submitted and 
approved by the internal evaluator thirty (30) days after 
initiation of the program. 

IX. FORMULA FOR PAYMENT 

A . St udent Point 



A student point is a unit of measure in the amount of 
$26,776.00 divided by the total point value for the number 
of assigned students. Each student will be assigned 4 
points for mathematics and/or 4 points for reading. 

Four points were selected in order to facilitate the com- 
putation for each student in each subject area on the basis 
of 75% payment (3 points) for norm reference tests and 25% 
payment (1 point) for criterion reference tests. 



B. Computation of Contractor Performance Payment 



1. Ranges of growth per student for point assignment 



Penalty : 

Up to and including .9 years 
growth (math) 

Less than 75% achievement on 
final criterion-referenced 
measure (math) 

Up to and including .9 years 
growth (reading) 

Less than 75% achievement on 
final criterion-referenced 
measure (reading) 



3 penalty pts . 



1 penalty pts . 
3 penalty pts . 



1 penalty pts. 



Achievement Guarantee: 



1.0 to 1.9 years growth (math) 
Satisfactory achievement on 
final criterion-referenced 
measure (math) 

1.0 to 1.9 years growth 
(reading) 

Satisfactory achievement on 
final criterion-referenced 
measure (reading) 



No assignment of pts. 

No assignment of pts. 
No assignment of pts. 

No assignment of pts. 



Bonus : 

2.0 or greater years growth 

(math) 3 bonus pts. 

85% or greater achievement on 
criterion-referenced (math) 
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1 bonus pts. 



2.0 or greater years growth 

(reading) 3 bonus pts . 

85% or greater achievement on 
criterion-referenced measure 

(reading) 1 bonus pts . 

2. Computation for final payment 

Following point assignment for all students , the balance 
(bonus points minus penalty points) will be used to de- 
termine final payment to Contractor. 

Penalty ; 

$26,775.00 - (Student point value x penalty pt . bal . ) 

Achievement Guarantee : 

$26,775.00 - (No penalty/no bonus) 

Bonus : 

$26,775.00 + $1.00 - (Contractor agreed acceptance 

for bonus condition , regard- 
less of number of bonus points 
earned . ) 

C. Payment Related to Student Withdrawal for Cause 

If the student leaves the project for cause, the Contractor 
will receive cost reimbursement of the $26,776.00 held in 
escrow based upon a linear proration of Contractor’s costs 
up to the time of the student’s departure. The Contractor’s 
reimbursement for the existing student’s final performance 
and his or her performance on any interim performance ob- 
jectives that have not been tested will be based upon a 
proration of the mean gain of the student’s class, up to 
the time of the student’s departure. 

X. TEACHER TRAINING 

Teacher training for the project will be conducted by EDL per- 
sonnel. The teaching staff will be selected from the LEA dis- 
trict for training and continued teaching activities within 
the learning center. Five lab directors and five paraprofes- 
sionals will be selected for training, with final approval of 
the Contractor and the LEA. They will be scheduled for a five- 
day, forty-hour training period prior to installation of the 
systems. Additional teachers will be selected and trained con- 
currently to provide a corpus of trained specialists who will 
be able to continue the instructional program if any staff mem- 
bers are unable to complete the year due to extended illness 
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or normal teacher attrition. The Contractor agrees to train 
20 additional district staff members in the operation of the 
system. The intent here is to form a nucleus of trained pro- 
fessionals within the Texarkana districts who can be used as 
resource teachers or staff development consultants during sub- 
sequent phases of the Texarkana Dropout Prevention Program. 

The initial training period will consist of five consecutive 
days. Training will include the component manager, all lab- 
directors, and all paraprof essionals and resource consultants 
(staff members to be trained). The training schedule (See Ap- 
pendix B, Contractor Proposal) will be adhered to during the 
f i ve -day initial training period . Twenty hours of on-going in- 
service training sessions or visitations will be conducted by 
EDL or authorized representatives. The resource consultants 
will act as consultants to lab directors as required, and will 
assume responsibility for assisting EDL teacher training per- 
sonnel during ongoing in-service training sessions. 

XI . TEACHER ADMINISTRATION POLICY 

The success of the LEA program depends on the willingness and 
ability of the teachers assigned to the program to use the 
methodology. If a personnel situation develops in which it ap- 
pears that a teacher may not be serving the best interest of 
the LEA program as mutually concluded by the component manager 
and the project director, the project director shall consider 
the replacement of such teacher. 

XII. DISSEMINATION POLICY 

Dissemination of information pertaining to planning , negotia- 
tion procedures, and interim activities related to the project 
will be mutually agreed on by project director and Contractor 
prior to its release to the public. 

All information pertaining to evaluation or test results may be 
disseminated only by the project director. Subsequent to public 
release of data and information and/or following completion of 
the present contract, the Contractor will have the right to pre- 
pare and distribute evaluation reports, based on released data, 
and to distribute reprints of this evaluation to interested par- 
ties . 

XIII. VISITATIONS 

Visitation privileges will be extended at the discretion of and 
with mutual agreement between the project director and the Con- 
tractor. Specified times and sites for visitation will be es- 
tablished, and made available upon request to potential visitors. 
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